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ANALYSIS  OF  PUBLICATIONS  ON 
NIH-SUPPORTED  RESEARCH 
1973-76  and  1977-80 

NIH — All  Institutes  Combined  and  the  Intramural  Program 


INTRODUCTION:  THE  BID-MEDLINE  PUBLICATION  DATA  SET 


This  report  presents  an  analytic  characterization  of  the  1973-80 
biomedical  research  publications  supported  by  the  National  Institutes  of 
Health.  Part  I  describes  NIH  publications  for  the  intramural  and  extramural 
research  programs  combined;  Part  II  focuses  on  intramural  research  publica¬ 
tions  only.  Parallel  analyses  have  been  conducted  for  each  of  the  Bureaus, 
Institutes,  and  Divisions  (BIDs),  and  a  report  on  each  Institute  is 
available. 

Since  1973,  CHI  Research,  the  research  group  at  Computer  Horizons,  Inc., 
has  worked  under  contract  to  NIH  (contracts  N01-0D-3-2109  and  N01-0D-1-2109) 
on  the  development  and  application  of  indicators  of  biomedical  research 
activity.  The  present  reports  are  a  product  of  this  collaborative 
association. 

These  reports  supersede  the  previous  set  of  bibliometric  evaluation 
reports  covering  the  period  1970-76  (11).  It  should  be  noted  that  the  first 
set  contained  no  report  for  the  total  NIH — all  Institutes  combined — or  for 
the  intramural  research  program.  The  reader  should  also  be  aware  that  the 
reports  for  the  individual  Institutes  from  these  two  sets  are  not  strictly 
comparable.  Partly  because  of  changes  in  MEDLINE  journal  coverage,  and 
partly  because  the  Institute  for  Scientific  Information  has  shifted  most 
behavioral  science  journals  from  the  Science  Citation  Index  (SCI)  to  the 
Social  Science  Citation  Index,  the  present  set  of  reports  is  limited  to 
coverage  of  clinical  medicine  and  biomedical  research.  Chemistry  and  psy¬ 
chology,  which  were  covered  in  the  previous  set  of  reports,  are  not  included 
in  the  computer-generated  data  of  this  set.  Paper  counts  obtained  manually, 
however,  were  used  in  certain  calculations,  as  noted  below. 

The  present  set  provides  a  comparative  analysis  of  the  papers  published 
in  a  selected  group  of  240  biomedical  journals  for  two  time  frames — 1973-76 
and  1977-80.  The  240-journal  set  contains,  overall,  about  75  percent  of  the 
NIH-supported  research  papers  published  during  this  period.  These  240  jour¬ 
nals  are  designated  as  the  "BID-MEDLINE  journal  set."  Limitation  of  the 
analysis  to  this  subset  of  journals  was  due  to  the  necessity  of  examining 
each  paper  individually  to  determine  sources  of  support.  Beginning,  how¬ 
ever,  with  the  publication  year  1981,  inclusion  of  data  on  support  acknowl¬ 
edgement  in  the  National  Library  of  Medicine's  MEDLINE  system,  which  covers 
about  2,000  biomedical  journals,  has  made  possible  more  extended  and  refined 
analyses . 
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Journal  Selection 


The  information  contained  here  is  drawn  from  an  analysis  of  some  460,000 
papers  published  between  1973  and  1980  in  240  biomedical  research  journals. 
The  publications  attributed  to  a  given  Institute  report  on  both  intramural 
and  extramural  (grant-  and  contract-supported)  research. 

The  need  to  examine  each  paper  for  acknowledgement  of  support  dictated 
restriction  of  the  study  to  a  limited  number  of  journals.  The  initial 
selection  aimed  at: 

•  Representing  all  biomedical  research  areas  by  their  most  influential 
(most  often  cited)  journals,  and 

•  Covering  as  many  of  the  papers  supported  by  NIH  as  possible. 

Through  selection  of  the  most  influential  journals  and  those  that 
maximize  coverage  of  NIH-supported  papers,  the  role  of  NIH  in  bioscience 
publication  is  somewhat  magnified.  Future  reports,  which  will  be  based  on 
all  MEDLINE/SCI-covered  journals,  will  include  many  in  which  NIH-supported 
authors  publish  less  frequently.  The  NIH  presence  in  these  collective 
fields  and  subfields  will  be  smaller. 

Previous  reports  on  these  bibliometric  studies  were  based  on  papers  in 
275  journals  covered  by  the  SCI.  During  the  evolution  of  the  present 
project,  it  was  decided  to  merge  the  set  with  the  MEDLINE  data  base  of  the 
National  Library  of  Medicine.  This  resulted  in  a  more  limited  data  set,  for 
the  process  of  merging  excluded  journals  not  common  to  the  two  component 
systems.  The  new  "BID-MEDLINE  journal  set  contains  240  journals. 

These  are  listed  by  subfield  in  Appendix  C.  Because  MEDLINE  has  limited 
its  coverage  of  Chemistry  in  recent  years,  and  neither  SCI  nor  MEDLINE 
offers  more  than  minimal  coverage  of  the  behavioral  sciences,  these  two 
fields  are  underrepresented  in  the  present  studies. 


Data  Capture 

Development  of  the  BID-MEDLINE  data  set  required  that  every  paper 
published  in  the  original  275  journals  between  1970  and  1980  be  scanned  to 
capture  acknowledgements  of  BID  support.  Up  to  three  acknowledgements  are 
tabulated  and  added  to  the  original  listings  drawn  from  the  SCI.  When  more 
than  one  source  of  support  is  acknowledged,  fractional  credits  are  assigned. 
For  example,  a  paper  acknowledging  both  NCI  and  NIAID  is  counted  as  one-half 
paper  for  each  Institute.  The  resulting  lists  are  then  matched  to  SCI 
corporate  tapes  to  obtain  author  institutional  affiliations.  Up  to  three 
affiliations  are  entered  in  the  data  set. 

The  final  step  in  the  development  of  the  240-journal  data  base  requires 
matching  the  papers  in  the  275  SCI  journals  to  the  MEDLINE  data  base.  This 
match  provides  titles  of  the  papers,  names  of  all  authors,  and  medical  sub¬ 
ject  headings  (MeSH:  index  terms).  The  product  of  this  match  constitutes 
the  240-journal  BID-MEDLINE  data  base,  1970-80. 
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Representativeness  of  the  Data 


Adequacy  of  coverage  of  the  original  275-journal  set  was  assessed 
principally  by  comparing  the  number  of  BID-supported  papers  found  in  these 
journals  with  the  numbers  reported  in  the  1973  NIH  Research  Grants  Index  and 
the  NIH  Pi rectory-Bibl iography.  In  making  these  comparisons,  books, 
abstracts,  and  other  inappropriate  (for  this  purpose)  items  were  not  counted. 
Overall,  the  selected  group  of  275  journals  contained  approximately  80  per¬ 
cent  of  all  NIH-supported  papers. 

The  adequacy  of  the  journal  set  was  also  assessed  by  correlating  the 
number  of  papers  in  each  biomedical  subfield  in  the  BID  set  with  the  number 
of  U.S.  papers  in  the  same  subfields  in  the  over  900  biomedical  journals  in 
the  Science  Citation  Index  (SCI).  Correlation  of  the  two  sets  was  .98. 


NIH  Support  of  Research  in  Chemistry  and  Psychology 

Although  the  unavailability  of  Chemistry  papers  in  MEDLINE  and  of  most 
Psychology  papers  in  both  SCI  and  MEDLINE  precludes  coverage  of  these  fields 
in  the  computer-generated  tables  in  this  report,  some  data  are  available. 

For  the  field  of  Chemistry,  information  on  source  of  support  has  been 
obtained  manually  for  the  entire  report  period,  1973-76  and  1977-80.  Psy¬ 
chology  data  are  available  through  1976.  These  data  have  been  used  in 
correlating  Institute  funding  with  research  publications. 

Table  1  shows  the  number  and  percent  of  each  BID'S  supported  papers  in 

the  original  275-BID-journal  set  for  (a)  Chemistry  for  the  periods  1973-76 

and  1977-80  and  (b)  Psychology  for  1970-76. 

Obviously,  the  loss  of  coverage  of  the  field  of  Chemistry  has  an 
important  effect  on  the  adequacy  with  which  the  publication  performance  of 

NIGMS  can  be  described.  With  12  percent  of  the  Institute's  publications 

omitted,  all  such  statistics  as  the  activity  index,  percent  of  internal 
effort,  and  citation  rates  are  somewhat  distorted.  While  the  effects  on  NCI 
and  NIADDK  data  are  substantial,  their  summary  statistics  should  not  be 
significantly  affected. 

Similarly,  the  loss  of  coverage  of  the  Psychology  literature  deprives 
NICHD  of  important  program  information  and  significantly  affects  other 
NICHD  publication  statistics.  Although  we  have  no  data  after  1976  on 
reports  of  psychological  research,  we  can  assume  that  at  least  NICHD  and 
NIA  performance  records  are  underrepresented  in  the  present  data  sets. 


Journal  Coverage 

One  of  the  limitations  of  basing  analyses  on  a  fixed  set  of  journals 
is  the  possibility  that  substantive  growth  of  a  discipline  may  result  in 
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Table  1 


NUMBER  AND  PERCENT  OF  NIH-SUPPORTED  PAPERS  ON 
CHEMISTRY  (1973-76  AND  1977-80) 

AND  PSYCHOLOGY  (1970-76)  IN  275  JOURNALS 

Chemistry  Psychology 


1973- 

■76 

1977 

-80 

1970-76 

Number 

Percent* 

Number 

Percent* 

Number 

Percent* 

NCI 

809 

6.6% 

1,031 

7.0% 

6 

0.1% 

NEI 

17 

0.9 

21 

0.9 

89 

3.1 

NHLBI 

197 

2.1 

244 

2.3 

33 

0.2 

NIA** 

0 

0.0 

5 

1.2 

5 

7.6 

NIADDK 

378 

3.9 

284 

3.0 

35 

0.2 

NIAID 

101 

1.7 

118 

2.2 

4 

0.1 

NICHD 

56 

1.1 

42 

0.9 

1,075 

12.7 

NIDR 

30 

2.0 

30 

2.2 

23 

0.9 

NIEHS 

Not  determined 

Not  determined 

Not  determined 

NIGMS 

1,031 

10.9 

1,191 

12.2 

117 

0.7 

NINCDS 

91 

1 .6 

59 

1.1 

416 

4.1 

^Percent  of  Institute's  papers  that  are  in  this  field. 

**NIA-supported  papers  first  appeared  in  1975. 


substantial  change  in  journal  utilization.  For  example,  new  journals  may 
draw  off  many  authors  in  a  rapidly  growing  specialty  area.  Such  changes  can 
be  expected  to  affect  BID  records  differentially  and  cannot  be  measured  with 
a  fixed  set  of  journals. 

A  special  study  (13)  was  made  during  the  past  year  to  assess  the  sig¬ 
nificance  of  this  kind  of  problem.  Two  subfields.  Endocrinology  and  Immu¬ 
nology,  were  selected  for  study.  They  were  chosen  for  different  reasons  and 
were  expected  to  produce  different  results.  Immunology  was  selected  because 
it  was  thought  to  be  a  candidate  for  rapid  advance  in  new  directions  that 
might  result  in  new  journals  and  changing  patterns  of  journal  utilization. 
Endocrinology  was  selected  because  it  was  perceived  as  not  having  changed 
dramatically  in  types  of  research  activity  in  recent  years,  and  hence  as  not 
likely  to  exhibit  marked  changes  in  publication  patterns. 

All  1975  and  1980  papers  in  SCI-covered  journals  in  the  two  subfields 
were  manually  examined  for  research  support  acknowledgements.  The  results 
were  compared  with  the  figures  obtained  from  the  corresponding  subfields  in 
the  240  BID-MEDLINE  journal  set.  (The  240  journal  set  covers  7  of  24  SCI- 
covered  Endocrinology  journals  and  9  of  36  SCI-covered  Immunology  journals.) 
Results  for  the  two  subfields  contrast  sharply. 
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Percent  of  NIH-Supported  Papers  in 
Two  Subfields  of  the  BID-MEDLINE  240-Journal  Set 


Endocrinology 


Immunology 


1975 


81.1 


65.9 


1980 


82.2 


58.5 


Although  the  7  Endocrinology  journals  in  the  240-journal  set  include  only 
56  percent  of  all  Endocrinology  papers,  they  publish  over  80  percent  of  NIH- 
supported  papers  in  this  field.  For  almost  all  BIDs,  these  7  journals 
captured  80  to  87  percent  of  the  acknowledgements  of  NIH  research  support  in 
both  1975  and  1980.  Only  NHLBI  Endocrinology  research  is  less  well  captured 
(70  percent  in  1975  and  64  percent  in  1980).  Overall,  it  is  apparent  that 
reports  based  on  the  240-journal  set  provide  accurate  intra-NIH  comparison 
information  but  overestimate  the  role  of  NIH  in  national  or  international 
comparisons. 

With  respect  to  Immunology,  however,  our  concerns  about  extent  of  coverage 
proved  well  founded.  The  extensions  of  this  field  are  not  well  reflected  in 
the  9  Immunology  journals  in  our  240-journal  set.  For  example,  while  NCI- 
supported  investigators  produced  57  percent  more  Immunology  papers  in  1980 
than  in  1975,  the  240-journal  set  shows  only  a  39  percent  increase.  NIAID 
investigators  produced  12  percent  more  Immunology  papers  in  1980,  but  the 
240-journal  set  shows  nearly  a  1  percent  reduction  in  the  number  of  supported 


papers . 


Overall,  the  Immunology  journals  in  our  set  captured  66  percent  of  NIH- 
supported  research  in  1975,  but  only  58.5  percent  of  the  NIH  papers  published 
in  1980.  While  70  percent  of  NIADDK-supported  papers  appeared  in  the  9 
journals  in  1980,  only  56  percent  of  NHLBI  and  58  percent  of  NIAID-supported 
papers  appeared  there.  Data  on  Immunology  publication  must  therefore  be 
interpreted  cautiously. 


Citation  Frequency 


The  number  of  times  each  paper  in  the  data  set  was  cited  has  been  added  to 
the  data  base,  utilizing  the  SCI  citation  tapes  for  1973  to  1980.  In  the 
citation  matching,  BID  and  institutional  identifications  as  well  as  MEDLINE 
data  have  been  retained  for  both  references  and  citations. 


Field  Coverage 


CHI  Research  has  assigned  all  SCI-covered  journals  to  one  of  nine  major 
fields  of  science: 
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Clinical  Medicine 

(1) 

Biomedical  Research 

(2) 

Biology 

(3) 

Chemistry 

(4) 

Physics 

(5) 

Earth  &  Space  Science 

(6) 

Engineering  &  Technology 

(7) 

Psychology 

(8) 

Mathematics 

(9) 

Since  the  240 

BID-MEDLINE  journals  primari 

ly  publish  reports  of  cli 

medicine  and  biomedical  research  (Fields  1  and 

2),  the  following  analys 

are  restricted  to 

these  two  areas.  Ninety-fou 

r  percent  of  the  papers  i 

these  journals  are  in  the  two  fields. 


nical 

es 

n 


Subject  and  Level  Classification 

A  journal  classification  system  has  been  developed  in  which  each 
biomedical  journal  is  assigned  to  1  of  46  biomedical  subfields.*  The  46 
subfields  are  also  collectively  grouped  into  clinical  medicine  or  biomedical 
(basic)  research.  The  journal  classification  thus  permits  characteri zation 
of  each  BID'S  research  support  activity  into  journal-defined  traditional 
disciplines,  such  as  Physiology,  Microbiology,  Immunology,  and  Pathology. 
These  subfields  are  listed  in  Table  2. 


Journals  have  also  been  assigned  to  a  "research  level."  The  level 
concept  assumes  the  existence  of  a  scale  ranging  from  clinical  observation 
(Level  1)  to  basic  science  (Level  4)  journals.  The  level  designations  and  a 
"prototype  journal"  for  each  level  are  as  follows: 


Level  1  -  Clinical  Observation.  Prototype: 

Journal  of  the  American  Medical  Association 

Level  2  -  Clinical  Mix.  Prototype: 

New  England  Journal  of  Medicine 

Level  3  -  Clinical  Investigation.  Prototype: 

Journal  of  Clinical  Investigation 

Level  4  -  Basic  Research.  Prototype: 

Journal  of  Biological  Chemistry 


Classification  by  level  affords  a  useful  perspective  for  consideration 
of  BID  programs.  The  classification  system  is  described  in  greater  detail 
in  references  1  and  2.  Additional  clarification  of  the  concept  may  be 
obtained  by  reviewing  the  level  assignment  of  each  of  the  journals  in  the 
240-journal  set  (Appendix  C). 


*A  few  multidisciplinary  journals  (e.g.,  Science.  Nature.  Proc.  Nat.  Acad. 
Sci . )  have  been  split — i.e.,  fractionally  assigned  to  more  than  one  subfield. 
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Table  2 


Field  and  Subfield  Classification  of  Publications 


Clinical  Medicine 

General  &  Internal  Medicine 
A1 lergy 

Anesthesiology 

Cancer 

Cardiovascular  System 
Dentistry 

Dermatology  &  Venereal  Diseases 

Endocrinology 

Fertility 

Gastroenterology 

Geriatrics 

Hematology 

Immunology 

Obstetrics  &  Gynecology 
Neurology  &  Neurosurgery 
Ophthalmology 
Orthopedics 

Arthritis  &  Rheumatism 

Otorhinolaryngology 

Pathology 

Pediatrics 

Pharmacology 

Pharmacy 

Psychiatry 

Radiology  &  Nuclear  Medicine 
Respiratory  System 
Surgery 

Tropical  Medicine 
Urology 
Nephrology 
Veterinary  Medicine 
Hygiene  &  Public  Health 


Biomedical  Research 

Physiology 

Anatomy  &  Morphology 
Embryology 
Genetics  &  Heredity 
Nutrition  &  Dietetics 
Biochemistry  &  Molecular 
Biology 
Biophysics 

Cell  Biology,  Cytology  & 
Histology 
Microbiology 
Virology 
Parasitology 
Biomedical  Engineering 
Miscellaneous  Biomedical 
Research 

General  Biomedical  Research 
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PART  I. 


TOTAL  NIH 


NIH  FUNDING  AND  PUBLICATION  TRENDS 


Figures  1  through  5  summarize  trends  in  funding  and  publication  for  NIH 
overall,  for  each  of  the  Institutes,  and  for  the  entire  BID-MEDLINE  data 

base. 

Figure  1  depicts  NIH  obligations  from  1965  through  1980,  in  constant 
(1969)  dollars.*  Between  1970  and  1980,  total  NIH  obligations  in  constant 
dollars  increased  by  62  percent. 

Figure  2  shows  all  NIH  papers.  Fields  1-9  in  the  BID-MEDLINE  data  set 
for  1970  through  1980.  Also  shown  are  the  remaining  U.S. -authored  and 
-supported  papers  in  this  data  set.  Between  1970  and  1980  the  total  NIH- 
supported  papers  increased  30  percent,  while  Other  U.S.  declined  13  percent 
(1973-80).  Over  the  decade,  total  BID-MEDLINE  papers  increased  40  percent. 
Data  for  1970-72  U.S.  and  U.S. -supported  papers  are  not  available,  so  the 
corresponding  change  cannot  be  determined. 

Figure  3  summarizes  the  changes  in  sources  of  support  for  the  BID- 
MEDLINE  papers.  Fields  1  and  2,  between  two  periods,  1973-76  and  1977-80. 

The  most  notable  changes  are  the  relatively  large  increase  in  the  foreign 
papers,**  from  29.6  percent  of  all  the  BID-MEDLINE  papers  (Fields  1  and  2) 
in  1973-76  to  32.9  percent  in  1977-80,  and  the  increase  from  20.5  to  23.1  in 
the  percent  of  U.S.  papers  that  acknowledged  no  support.  Although  the  per¬ 
cent  of  NIH-supported  papers  decreased  from  29.1  to  28.0,  the  number  of  such 
papers  increased. 


*Constant  dollar  estimates  based  on  NIH  Biomedical  R&D  Price  Index. 


**Foreign  papers  are  those  with  foreign 
supported  by  a  U.S.  agency.  For  example, 
acknowledging  support  from  NCI  is  counted 
a  foreign  paper. 


institutional  authors  who  are  not 

a  French  scientist's  paper 

as  an  NCI-supported  paper,  not  as 
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Figure  1 


NIH  OBLIGATIONS,  FISCAL  YEARS  1  965-  1  980, 
IN  CONSTANT  (1969)  DOLLARS* 

$  MILLIONS 


FISCAL  YEAR 


*1965-68  data  from  "Basic  Data  Relating  to  the  National  Institutes  of 
Health,  1976,"  p.  15.  1969-80  data  from  "Basic  Data  Relating  to  the 

National  Institutes  of  Health,  1981,"  p.  11.  NIH  Publication  No.  81- 
1261,  May  1981.  Excludes  FIC,  NLM,  OD,  Buildings  and  Facilities,  HRF 
construction  grants,  and  programs  that  have  been  transferred  out  of  NIH. 
Biomedical  Price  Index  was  used  to  adjust  current  to  constant  dollars. 
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Figure  2 

NIH-SUPPORTED  AND  ALL  OTHER  U.S. -SUPPORTED  PAPERS 
BID-SCI  JOURNAL  SET,  FIELDS  1-9,  1970-80* 

PAPERS 
IN  THOUSANDS 
36  r 


35 

34 

33 


32 


31 


30 


y 


ot 


70  71  72  73  74  75  76  77  78  79  80 

FISCAL  YEAR 


*Dat.a  not.  available  on  all  U.S. -authored 
and  -supported  papers  for  1970-72. 
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Figure  3 

PERCENT  DISTRIBUTION  OF  BIOMEDICAL  RESEARCH  PUBLICATIONS 
BY  SOURCE  OF  SUPPORT,  1973-76  AND  1977-80 
(BIO-MEDLINE  FIELDS  1  AND  2) 


205,922  PAPERS 
1973-76 


229,375  PAPERS 
1977-80 
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Figures  4  and  5  permit  comparison  of  overall  trends  in  funding  and 
publication  for  the  NIH  BIDs  covered  in  this  series  of  evaluation  reports. 

Figure  4  depicts  total  obligations  for  each  BID,  from  1965  through  1980, 
in  1969  dollars.  Between  1970  and  1976,  changes  in  constant-dol lar 
obligations  fluctuated  for  most  BIDs.  NCI  and  NHLBI  obligations  increased 
greatly;  increases  were  smaller  but  consistent  for  NEI  and  NIEHS.  Some  BIDs 
actually  declined  in  financial  strength  over  this  period.  Between  1976  and 
1980,  however,  obligations  in  constant  dollars  increased  moderately  for  all 
BIDs  except  NCI  and  NIDR. 

Figure  5  shows  corresponding  publication  trends  for  the  NIH  BIDs  from 
1970  through  1980.  Close  relations  between  publications  and  funding  are 
clearly  depicted  in  the  large  increase  in  annual  publication  rates  for  NCI 
and  NHLBI  and  in  the  manner  in  which  most  BIDs  range  below  them.  NIADDK  and 
NIGMS  appear  to  be  the  exceptions.  They  seem  to  support  a  great  many  more 
publications  than  would  be  expected,  given  their  sizes.  The  apparent 
discrepancy  occurs  because  these  two  institutes  support  proportionally  more 
basic  science  research  than  do  other  BIDs,  and  basic  scientists  on  average 
publish  many  more  papers  than  do  clinicians. 

Data  are  not  available  to  permit  discussion  of  rate  of  publication  per 
support  dollar,  etc.,  nor  are  they  sought.  While  for  NIH  as  a  whole  the 
correlation  between  funding  and  publication  rate  is  extremely  high 
(r  =  .90),  such  relationships  may  break  down  when  smaller  aggregates  are 
analyzed.  Characteristic  differences  between  disciplines  and  classes  of 
disciplines  (e.g.,  clinical  vs.  basic  science),  between  individual 
scientists  and  those  working  in  interdisciplinary  groups,  among  stages  of 
development  of  subdiscipline  specialty  areas,  etc.,  may  mask  a  strong 
underlying  relationship.  Therefore,  when  small  aggregates  of  data  are  the 
focus  of  interest,  care  in  analyzing  potential  covariates  is  essential. 
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Figure  4 


BID  Obligations  1965-1980 
(1969  Constant  Dollars) 


Year 


•Based  on  NIH  Biomedical  R&D  Price  Index 
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Number  of  Papers  Acknowledging  NIH  Support  in  275 
Scientific  Journals 


Figure  5 


Acknowledgements  of  Research 
Support  Appearing  in  275  Scientific  Journals 


Note:  The  paper  counts  in  this  figure  are  for  Fields  1  through  9, 
but  90  percent,  of  the  total  papers  are  in  Fields  1  and  2. 
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NIH  PUBLICATION  ACTIVITY 


The  tables  and  graphs  in  this  section  present  a  detailed  bibliometric 
profile  of  NIH-supported  research  in  the  BID-MEDLINE  journals.  Since  one 
goal  of  this  report  is  to  identify  changes  in  NIH-supported  research 
activity,  most  of  the  publication  profile  data  are  presented  for  two 
periods — 1973-76  and  1977-80.  Research-level  and  research-field  profiles  of 
NIH-supported  papers  are  presented  in  Tables  3  and  4,  and  publication 
profiles  relating  NIH-supported  papers  to  all  BID-MEDLINE  papers  by  research 
area  are  presented  in  Figures  6A,  6B,  7A,  and  7B  (constructed  directly  from 
data  in  Tables  5A  and  5B). 


Research-Level  Profile 


Table  3  presents  the  level  classification  of  NIH-supported  publications 
for  the  two  periods  1973-76  and  1977-80.  There  was  a  decrease  in  the  number 
and  percent  of  NIH-supported  papers  at  the  more  clinical  levels  (1  and  2) 
and  an  increase  in  number  and  percent  of  NIH-supported  papers  at  the  more 
basic  levels — Clinical  Investigation  (Level  3)  and  Basic  Research  (Level 
4).  It  should  be  noted  that  nearly  80  percent  of  the  NIH-supported  papers 
are  at  Levels  3  and  4,  and  that  nearly  50  percent  are  at  4. 


Table  3 

Number  and  Percent  of  All  NIH- 
Supported  Papers  in  Fields  1  and  2  According  to 
Research  Level,  1973-76  and  1977-80 


Level 

1973 

-76 

1977 

i 

00 

lo 

* 

Levels  1  &  2 

(Clinical  Observation 

Number 

Percent 

Number 

Percent 

&  Clinical  Mix) 

14,377 

24% 

13,786 

21 5. 

Level  3 

(Clinical  Investigation) 

18,250 

30 

19,845 

31 

Level  4  (Basic  Research) 

27,316 

46 

31 .279 

48 

Total 

59,943 

100% 

64,910 

100% 

*1980  data  include  a  5  percent  estimate  for  1980  papers  appearing  on  1981  SCI 
tapes . 
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Publication  Counts 


Figures  6A  and  B  show  the  percent  of  all  papers  in  clinical  medicine  and 
biomedical  research,  respectively,  in  the  BID-MEDLINE  journal  set  that  were 
NIH-supported.  Publication  activity  for  the  two  periods  1973-76  and  1977-80 
is  shown  for  each  subfield.  Clinical  medicine  comprises  32  subfields  as  de¬ 
fined  in  the  240-journal  set;  biomedical  research,  14. 

NIH  supported  a  substantial  number  of  papers  in  nearly  every  subfield. 

In  Cancer  and  Immunology,  NIH  supported  more  than  40  percent  of  the  total 
1973-80  BID-MEDLINE  papers.  It  supported  more  than  30  percent  of  all  papers 
in  seven  other  subfields  of  clinical  medicine:  Allergy,  Cardiovascular 
System,  Endocrinology,  Hematology,  Ophthalmology,  Pathology,  and  Respiratory 
System. 

Among  the  subfields  designated  as  biomedical  research,  NIH  supported 
more  than  40  percent  of  all  the  1973-80  papers  in  each  of  the  following: 
Physiology,  Anatomy-Morphology,  and  Virology.  NIH  supported  more  than  30 
percent  of  the  total  papers  in  five  additional  subfields  of  biomedical 
research:  Embryology,  Biochemistry-Molecular  Biology,  Biophysics,  Cell 
Biology-Cytology-Histology,  and  Miscellaneous  Biomedical  Research. 

For  most  subfields  the  percent  of  total  BID-MEDLINE  papers  that  acknowl¬ 
edged  NIH  support  decreased  from  the  first  period,  1973-76,  to  the  second, 
1977-80.  These  decreases  occurred  in  24  of  the  32  subfields  of  clinical 
medicine  (Figure  6A) .  The  NIH  share  increased  in  only  four  of  the  clinical 
subfields.  In  the  more  basic  subfields  (Figure  6B) ,  the  NIH-supported  pro¬ 
portion  decreased  in  6  and  increased  in  5  (of  14).  As  previously  noted, 
foreign  papers  increased  from  29.6  percent  of  the  total  BID-MEDLINE  papers 
(Fields  1  and  2)  to  32.9  percent,  and  the  percent  of  papers  that  acknowl¬ 
edged  no  support  increased  from  20.5  to  23.1  percent  (see  Figure  3). 


Activity  Indexes 

NIH  publication  activity  is  described  from  another  perspective  in  Fig¬ 
ures  7A  and  7B,  which  show  the  distribution  of  "activity  indexes"  for  the 
two  periods  1973-76  and  1977-80.  The  activity  index  is  a  ratio  of  percent¬ 
ages;  it  is  determined  by  dividing  the  percent  of  an  Institute's  papers  in  a 
subfield  by  the  percent  of  all  journal  papers  in  the  subfield  (as  subfields 
are  defined  in  the  BID-MEDLINE  journal  set).  Expressed  another  way,  the 
graphs  display  areas  in  which  NIH's  publication  activity  is  high  relative 
both  to  the  size  of  NIH  and  to  the  size  of  the  subfield.  Thus,  an  activity 
index  of  1.0  would  represent  equivalence  between  the  size  of  the  NIH  effort 
in  a  given  subfield  and  the  size  of  the  subfield  in  the  BID-MEDLINE  journal 
set.  Activity  indexes  greater  than  1.0  indicate  areas  of  NIH  relative 
emphasis . 

The  subfields  in  which  NIH  had  high  activity  indexes  (>1.4),  and  had  at 
least  1  percent  of  its  papers,  are  Cancer,  Immunology,  Physiology,  and 
Vi rology . 
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Figure  6A 

Total  NIH 


Percent  of  All  Papers  in 
Each  Subfield  of  Clinical  Medicine 
Supported  by  or  Performed  by  NIH 

240  BID-MEDLINE  Journals 


SCIENTIFIC  FIELD  Number 
Subfield  of 
Papers 

CLINICAL  MEDICINE 


Genrl  Sc  Internal  Med 
Allergy 
Anesthesiology 
Cancer 

Cardiovascular  Systm 
Dentistry 
Dermat  Sc  Venerl  Dis 
Endocrinology 
Fertility 
Gastroenterology 
Geriatrics 
Hematology 
Immunology 
Obstetrics  Sc  Gynecol 
Neurol  Sc  Neurosurg 
Ophthalmology 


5415 

4630 

147 

177 

367 

242 

3701 

4257 

1911 

1949 

726 

755 

366 

329 

2273 

2422 

298 

232 

466 

535 

162 

120 

661 

811 

3457 

4271 

453 

516 

3420 

3831 

1194 

1126 


Percent 

0  10  20  30  40  50 


NIH 

1973—1976 

1977-1980 

0  10  20  30  40  50 

Percent 
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Figure  6A  (Continued) 

Total  NIH 

Percent  of  All  Papers  in 
Each  Subfield  of  Clinical  Medicine 
Supported  by  or  Performed  by  NIH 

240  BID-MEDLINE  Journals 


SCIENTIFIC  FIELD  Number 
Subfield  of 
Papers 

CLINICAL  MEDICINE 


Orthopedics 
Arthritis  Sc  Rheumat 
Otorhinolaryngology 
Pathology 
Pediatrics 
Pharmacology 
Pharmacy 
Psychiatry 
Radiology  &  Nucl  Med 
Respiratory  System 
Surgery 
Tropical  Medicine 
Urology 
Nephrology 
Veterinary  Medicine 
Hygiene  <$c  Pub!  Hlth 


63 

97 

174 

231 

462 

259 

1085 

1013 

1134 

1267 

1739 

2004 

619 

626 

123 

131 

909 

863 

384 

464 

1486 

1160 

152 

137 

246 

265 

47 

63 

300 

297 

295 

313 


Percent 

0  10  20  30  40  50 


NIH 

1973-1976 

1977-1980 

1 


0  10 
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20  30  40  50 

Percent 


Figure  6B 

Total  NIH 


Percent  of  All  Papers  in 
Each  Subfield  of  Biomedical  Research 
Supported  by  or  Performed  by  NIH 

240  B1D-MEDLINE  Journals 


SCIENTIFIC  FIELD  Number 
Subfield  of 
Papers 

BIOMED  RESEARCH 


Percent 

10  20  30  40  50 


Physiology 
Anatomy  8c  Morphology 
Embryology 
Genetics  8c  Heredity 
Nutrition  8c  Dietet 
Biochem  8c  Molec  Biol 
Biophysics 
Cell  Biol  Cyt  8c  Hist 
Microbiology 
Virology 
Parasitology 
Biomedical  Enginmg 
Misc  Biomedical  Res 
Genrl  Biomedical  Res 
BIOLOGY 


2117 

2714 

388 

371 

463 

502 

688 

665 

442 

614 

11226 

12527 

198 

301 

1855 

2079 

1233 

1090 

1485 

1783 

434 

318 

160 

165 

219 

198 

4804 

5394 


783 

412 


NIH 

1873—1976 

mm 

1977-1980 

0  10  20  30  40  50 

Percent 


19 


Figure  7A 

Total  NIH  Activity  Indexes  in 
Subfields  of  Clinical  Medicine 

240  BID-MEDLINE  Journals 
1973-1976  over  1977-1980 


SCIENTIFIC  FIELD 
Subfield 

CLINICAL  MEDICINE 
Genrl  &  Internal  Med 
Allergy 
Anesthesiology 
Cancer 

Cardiovascular  Systm 
Dentistry 
Dermat  &  Vener!  Dis 
Endocrinology 
Fertility 
Gastroenterology 
Geriatrics 
Hematology 
Immunology 
Obstetrics  Gynecol 
Neurol  ic  Neurosurg 
Ophthalmology 


INDEX  = 


Number 

of 

Papers  q 


%  of  Institute's  Papers  in  Subfield 
%  of  240  Journals’  Papers  in  Subfield 

Index 

1  2  3  4  5 


5415 

4630 

147 

177 

367 

242 

3701 

4257 

1911 

1949 

726 

755 

366 

329 

2273 

2422 

298 

232 

466 

535 

162 

120 

661 

811 

3457 

4271 

453 

516 

3420 

3831 


1194 

1126 


0  1  2  3  4  5 

Index 

Note:  Open  bars  designate  subfields  that  contained  less  than  1  percent 
of  the  papers  acknowledging  NIH  support  in  the  given  period. 
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Figure  7 A  (Continued) 

Total  NIH  Activity  Indexes  in 
Subfields  of  Clinical  Medicine 


SCIENTIFIC  FIELD 
Subfield 

CLINICAL  MEDICINE 
Orthopedics 
Arthritis  ic  Rheumat 
Otorhinolaryngology 
Pathology 
Pediatrics 
Pharmacology 
Pharmacy 
Psychiatry 
Radiology  &  Nucl  Med 
Respiratory  System 
Surgery 
Tropical  Medicine 
Urology 
Nephrology 
Veterinary  Medicine 
Hygiene  ic  Publ  Hlth 


240  BID-MEDLINE  Journals 
1973-1976  over  1977-1980 


%  of  Institute’s  Papers  in  Subfield 

INDEX  =  - - — - - - - — 

%  of  240  Journals’  Papers  in  Subfield 


Number 

of 

Index 

Papers  q 
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5 

63 

97 

174 
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123 
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909 
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384 
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1160 

152 
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47 

63 

300 
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295 

313 
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Index 


Note:  Open  bars  designate  subfields  that  contained  less  than  1  percent 
of  the  papers  acknowledging  NIH  support  in  the  given  period. 
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Figure  7B 

Total  NIH  Activity  Indexes  in 
Subfields  of  Biomedical  Research 


240  BID-MEDLINE  Journals 
1973-1976  over  1977-1980 


INDEX  = 

SCIENTIFIC  FIELD  Number 
Subfield  of 

Papers  q 


%  of  Institute’s  Papers  in  Subfield 
%  of  240  Journals’  Papers  in  Subfield 

Index 

1  2  3  4  5 


BIOMED  RESEARCH 


Physiology 
Anatomy  8c  Morphology 
Embryology 
Genetics  8c  Heredity 
Nutrition  8c  Dietet 
Biochem  8c  Molec  Biol 
Biophysics 
Cell  Biol  Cyt  8c  Hist 
Microbiology 
Virology 
Parasitology 
Biomedical  Enginmg 
Misc  Biomedical  Res 
Genrl  Biomedical  Res 
BIOLOGY 


2117 

2714 

388 

371 

463 

502 

688 

665 

442 

614 

11226 

12527 

198 

301 

1855 

2079 

1233 

1090 

1485 

1783 
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160 
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198 
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Note:  Open  bars  designate  subfields  that  contained  less  than  1  percent 
of  the  papers  acknowledging  NIH  support  in  the  given  period. 
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Publication  Trends 


Another  perspective  on  NIH  research  dynamics  may  be  gained  in  comparing 
the  rate  of  change  in  NIH-supported  papers  with  changes  occurring  in  Other 
U.S.-  authored  and  U.S. -supported  papers  over  the  same  period.  Table  4  pre¬ 
sents  changes  for  NIH  and  for  Other-U.S.  in  each  of  the  selected  subfields. 

Of  the  total  number  of  papers  published  by  the  BID-MEDLINE  journals  during 
1973-77  and  1977-80,  NIH  supported  41  and  42  percent.  However,  the  NIH- 
supported  share  of  papers  in  basic  biomedical  journals  rose  from  50  to  54  per¬ 
cent,  while  the  share  of  clinical  papers  decreased  from  36  to  34  percent.  The 
Percent  Change  figures  in  Table  4  depict  these  changes  by  discipline.  While 
the  number  of  NIH-supported  biomedical  research  papers  increased  11.7  percent, 
papers  not  supported  by  NIH  decreased  7.1  percent.  Concurrently,  NIH-supported 
clinical  research  increased  insignificantly  (3.4  percent)  while  clinical  re¬ 
search  papers  not  supported  by  NIH  increased  11.7  percent.  It  is  apparent  that 
during  the  70 ' s  clinical  investigators  who  were  not  supported  by  the  NIH  sub¬ 
stantially  increased  their  publication  activity.  Meanwhile,  NIH  support 
shifted  slightly  toward  the  more  basic  biomedical  sciences.  These  results 
suggest  greater  independence  of  clinical  research  and  greater  access  to 
alternative  sources  of  support. 

Although  the  overall  number  of  NIH-supported  clinical  research  papers 
increased  only  3.4  percent  in  the  1977-80  period,  that  figure  masks  wide- 
ranging  shifts  in  emphasis  among  NIH-supported  clinical  investigations.  These 
changes  range  from  a  43.9  percent  decrease  (in  Otorhinolaryngology)  to  a  54 
percent  increase  (in  Orthopedics).  The  NIH  role  in  Otorhinolaryngology  de¬ 
clined  from  39  to  18  percent  as  the  research  papers  that  were  not  supported  by 
NIH  increased  22.4  percent.  The  circumstance  in  Orthopedics  is  different  only 
with  respect  to  the  evidence  of  increased  NIH  involvement.  The  NIH  increase 
is  overshadowed  by  a  78  percent  increase  in  the  number  of  papers  supported  by 
other  U.S.  sources.  Despite  increased  interest,  the  NIH  share  of  Orthopedics 
research  papers  declined  from  11  to  9  percent.  Other  subfields  in  which  the 
rate  of  increase  in  NIH-supported  research  lagged  behind  more  rapidly  in¬ 
creasing  activity  outside  of  the  NIH  purview  include  Allergy,  Arthritis  and 
Rheumatology,  Cancer,  Nephritis,  and  Neurology  and  Neurosurgery. 

Other  subfields  in  which  NIH  support  decreased  notably,  as  compared  with 
other  U.S.,  are,  (besides  Otorhinolaryngology),  Anesthesiology,  Surgery, 

General  and  Internal  Medicine,  and  Dermatology-Venereal  Diseases.  In  all  five 
of  these  subfields,  the  number  of  NIH-supported  papers  dropped  both  absolutely 
and  relatively  from  the  1973-76  period  to  the  1977-80.  In  two  other  fields. 
Geriatrics  and  Fertility,  both  NIH  and  Other-U.S.  papers  decreased  markedly. 

A  different  kind  of  dynamic  is  implied  when  substantial  increases  in  the 
number  of  papers  acknowledging  NIH  support  are  accompanied  by  significant  de¬ 
creases  in  the  Other-U.S.  category.  This  kind  of  change  occurred  in  Hema¬ 
tology,  Respiratory  System  research  and  Virology.  Clearly,  strong  or  rapid 
increases  in  programmatic  emphases  may  not  immediately  change  the  national 
pace  of  production  of  publishable  research.  It  is  conceivable,  however,  that 
in  the  process  of  drawing  a  large  proportion  of  the  national  effort  into  the 
NIH  milieu,  a  new  vigor  may  be  generated  that  will  later  find  expression  in 
significant  scientific  advances  and  increased  productivity.  As  1980's  data 
become  available,  the  outcome,  if  not  the  operating  dynamics,  will  become 
evident. 
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Table  4 


Changes  in  Number  and  Percent  of  Papers  Supported  by  NIH 
and  the  Rest  of  the  Nation,  in  Selected  Subfields 
(240  BID-MEDLINE  Journals),  1973-76  and  1977-80 


Number  of  Papers 

Percent 


1973-76 

1977-80 

Change 

Fields  1  and  2  Combined 

All  NIH 

59,945 

64,113 

7.0 

Other  U.S. 

84,934 

89,733 

5.7 

Clinical  Medicine  [Field  1] 

All  NIH 

34,232 

35,390 

3.4 

Other  U.S.* 

58,994 

65,638 

11.3 

General  and  Internal  Medicine 

All  NIH 

5,415 

4,630 

-14.5 

Other  U.S. 

8,551 

9,343 

9.3 

Allergy 

All  NIH 

147 

177 

20.4 

Other  U.S. 

155 

217 

40.0 

Anesthesiology 

All  NIH 

367 

242 

-34.1 

Other  U.S. 

938 

973 

3.7 

Arthritis  and  Rheumatism 

All  NIH 

174 

231 

32.8 

Other  U.S. 

242 

358 

47.9 

Cancer 

All  NIH 

3,701 

4,257 

15.0 

Other  U.S. 

2,274 

3,143 

38.2 

Cardiovascular  System 

All  NIH 

1,911 

1 ,949 

2.0 

Other  U.S. 

2,712 

2,807 

3.5 

Dentistry 

All  NIH 

726 

755 

4.0 

Other  U.S. 

1,717 

1,779 

3.6 

*0ther  U.S.  includes  all  U.S. -authored  and 

U.S. -supported  papers 

except 

those  supported  by  NIH. 
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Table  4 


Changes  in  Number  and  Percent  of  Papers  Supported  by 
and  the  Rest  of  the  Nation,  in  Selected  Subfields 
(240  B I D— ME D LINE  Journals),  1973-76  and  1977-80 

(Continued) 


Number  of  Papers 
1973-76  1977-80 

Dermatology  and 
Venereal  Diseases 


All  NIH 

366 

329 

Other  U.S. 

755 

921 

Endocrinology 

All  NIH 

2,273 

2,422 

Other  U.S. 

1,944 

1,590 

Fertility 

All  NIH 

298 

232 

Other  U.S. 

781 

636 

Gastroenterology 

All  NIH 

466 

535 

Other  U.S. 

782 

844 

Geriatrics 

All  NIH 

162 

120 

Other  U.S. 

1 ,046 

789 

Hematology 

All  NIH 

661 

811 

Other  U.S. 

524 

460 

Immunology 

All  NIH 

3,457 

4,271 

Other  U.S. 

2,367 

2,616 

Nephrology 

All  NIH 

47 

63 

Other  U.S. 

97 

155 

Neurology  and 
All  NIH 

Neurosurgery 

3,420 

3,431 

Other  U.S. 

3,874 

5,147 

Obstetrics  and 
All  NIH 

Gynecology 

453 

516 

Other  U.S. 

2,049 

2,169 

NIH 


Percent 

Change 


-10.1 

22.0 


6.6 

-18.2 


-22.1 

-18.6 


14.8 

7.9 


-25.9 

-24.6 


22.7 

-12.2 


23.5 

10.5 


34.0 

59.8 


12.0 

32.9 


13.9 

5.9 
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Table  4 


Changes  in  Number  and  Percent  of  Papers  Supported  by  NIH 
and  the  Rest  of  the  Nation,  in  Selected  Subfields 
(240  BID-MEDLINE  Journals),  1973-76  and  1977-80 

(Continued) 


1973-76 

Number  of  Papers 

1977-80 

Percent 

Change 

Ophthalmology 

All  NIH 

1,194 

1,126 

-5.7 

Other  U.S. 

1,229 

1,467 

19.4 

Orthopedics 

All  NIH 

63 

97 

54.0 

Other  U.S. 

582 

1  ,036 

78.0 

Otorhinolaryngology 

All  NIH 

462 

259 

-43.9 

Other  U.S. 

1 ,185 

1  ,451 

22.4 

Pathology 

All  NIH 

1 ,085 

1,013 

-6.6 

Other  U.S. 

1,329 

1,459 

9.8 

Pediatrics 

All  NIH 

1 ,134 

1,267 

11.7 

Other  U.S. 

2,248 

2,994 

33.2 

Pharmacology 

All  NIH 

1,739 

2,004 

15.2 

Other  U.S. 

3,256 

3,483 

7.0 

Pharmacy 

All  NIH 

619 

626 

1.1 

Other  U.S. 

1,867 

1,744 

-6.6 

Psychiatry 

All  NIH 

123 

131 

6.5 

Other  U.S. 

2,483 

2,589 

4.3 

Radio  and  Nuclear  Medicine 

All  NIH 

909 

863 

-5.1 

Other  U.S. 

2,845 

3,989 

40.2 

Respiratory  System 

All  NIH 

384 

464 

20.8 

Other  U.S. 

579 

437 

-24.5 
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Table  4 


Changes  in  Number  and  Percent  of  Papers  Supported  by  NIH 
and  the  Rest  of  the  Nation,  in  Selected  Subfields 
(240  BID-MEDLINE  Journals),  1973-76  and  1977-80 

(Continued) 


Number  of  Papers 

Percent 


1973-76 

1977-80 

Change 

Surgery 

All  NIH 

1 ,486 

1,160 

-21.9 

Other  U.S. 

6,127 

6,274 

2.4 

Tropical  Medicine 

All  NIH 

152 

137 

-9.9 

Other  U.S. 

262 

330 

26.0 

Urology 

All  NIH 

246 

265 

7.7 

Other  U.S. 

1,539 

1,670 

8.5 

Veterinary  Medicine 

All  NIH 

300 

297 

-1.0 

Other  U.S. 

1,583 

2,255 

42.5 

Hygiene  and  Public  Health 

All  NIH 

295 

313 

6.1 

Other  U.S. 

1 ,069 

906 

-15.2 

Biomedical  Research  [Field  2] 

All  NIH 

25,711 

28,721 

11  .7 

Other  U.S. 

25,944 

24,104 

-7.1 

Anatomy  and  Morphology 

All  NIH 

388 

371 

-4.4 

Other  U.S. 

250 

244 

-2.4 

Biochemistry  and 

Molecular  Biology 

All  NIH 

11,226 

12,527 

11.6 

Other  U.S. 

9,119 

8,822 

-3.3 

Biomedical  Engineering 

All  NIH 

160 

165 

3.1 

Other  U.S. 

242 

274 

13.2 

Biophysics 

All  NIH 

198 

301 

52.0 

Other  U.S. 

293 

356 

21.5 
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Table  4 


Changes  in  Number  and  Percent  of  Papers  Supported  by  NIH 
and  the  Rest  of  the  Nation,  in  Selected  Subfields 
(240  BID-MEDLINE  Journals),  1973-76  and  1977-80 

(Continued) 


Number  of  Papers 

Percent 

1973-76 

1977-80 

Change 

Embryology 

All  NIH 

463 

502 

8.4 

Other  U.S. 

385 

421 

9.4 

Genetics  and  Heredity 

All  NIH 

688 

665 

-3.3 

Other  U.S. 

827 

771 

-6.8 

Microbiology 

All  NIH 

1,233 

1 ,090 

-11.6 

Other  U.S. 

2,009 

1,490 

-25.8 

Nutrition  and  Dietetics 

All  NIH 

442 

614 

38.9 

Other  U.S. 

693 

1 ,027 

48.2 

Cell  Biology,  Cytology, 
and  Histology 

All  NIH 

1 ,855 

2,079 

12.1 

Other  U.S. 

1,541 

1  ,572 

2.0 

Pa rasitology 

All  NIH 

434 

318 

-26.7 

Other  U.S. 

713 

627 

-12.1 

Physiology 

All  NIH 

2,117 

2,714 

28.2 

Other  U.S. 

1,723 

1,622 

-5.9 

Vi rology 

All  NIH 

1,485 

1,783 

20.1 

Other  U.S. 

1 ,099 

953 

-13.3 

General  Biomedical  Research 

All  NIH 

4,804 

5,394 

12.3 

Other  U.S. 

6,697 

5,609 

-16.2 

Miscellaneous  Biomedical 
Research 

All  NIH 

219 

198 

-9.6 

Other  U.S. 

351 

314 

-10.5 
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NIH  CITATION  PERFORMANCE 


The  distribution  of  the  number  of  citations  received  by  any  aggregate  of 
journal  papers  is  extremely  skewed.  In  general,  relatively  few  papers  in  a 
field  are  highly  cited,  and  relatively  many  are  cited  once  or  twice  or  not 
at  all.  Given  these  skewed  distributions,  measures  of  central  tendency  are 
of  somewhat  limited  value  as  analytic  tools.  By  making  use  of  all  the  in¬ 
formation  in  a  distribution  of  citation  rates,  however,  it  is  possible  to 
create  a  statistic  that  permits  comparison  of  the  rates  achieved  by  sup¬ 
ported  researchers  in  different  disciplines.  "T-scores"  provide  such  infor¬ 
mation  (see  page  34  for  a  description  of  the  method  of  computation).  An 
alternative  way  of  assessing  citation  impact  is  to  compare  the  frequency  of 
highly  cited  papers  between  groups. 

Figure  8*  shows  the  percent  of  NIH-supported  papers  that  are  in  the  top 
decile  of  cited  papers  in  each  subfield  represented  in  the  BID-MEDLINE  jour¬ 
nal  set.  This  statistic  has  the  advantage  that  a  top  decile  is  interpret¬ 
able  across  both  subfields  and  years,  even  though  the  proportions  are  based 
upon  different  numbers  of  citations  in  each  cited  year  and  in  each  subfield. 

Citations  from  1973-80  papers  to  journal  papers  published  between  1973 
and  1977  were  used  to  formulate  Figure  8.  Graphic  representations  are 
limited  to  the  subfields  in  which  more  than  1  percent  of  NIH's  supported 
papers  appear. 

In  each  of  the  21  subfields  in  which  NIH  was  most  active  over  the  entire 
period,  more  than  10  percent  of  the  NIH-supported  papers  were  in  the  top 
decile  of  cited  papers.  The  figure  does  not  reveal  that  in  each  of  46  sub¬ 
fields  in  which  NIH  supported  any  papers,  more  than  10  percent  were  in  the 
top  decile.  Moreover,  in  eight  of  these  subfields,  more  than  20  percent  of 
the  NIH-supported  papers  were  in  the  top  decile  (see  Table  5). 

Historical  trends  can  be  observed  in  Tables  5A  and  5B,  where  complete 
profiles  for  the  two  periods  1973-76  and  1977-80  are  presented. 


*The  data  in  Figure  8  are  not  be  be  compared  with  those  of  the  corre¬ 
sponding  figure  in  the  previous  report,  which  covered  the  1970-76  publi¬ 
cations  (ref. 11).  Note  that  the  period  covered  in  the  present  report  is 
1973-77,  and  that  subfields  including  fewer  than  1  percent  of  the  BID'S 
supported  papers  are  not  charted. 
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Figure  8 

Total  NIH 


Percent  of  BID'S  Papers  in  Top  Decile  of  Cited  Papers 

1973-1980  Papers  in  240  BID— MEDLINE  Journals 


SCIENTIFIC  FIELD  Number 

Subfield  _  of 
Papers 


CLINICAL  MEDICINE 
Genrl  &  Internal  Med 
Allergy 
Anesthesiology 
Cancer 

Cardiovascular  Systm 
Dentistiy 
Dermat  6c  Venerl  Dis 
Endocrinology 
Fertility 
Gastroenterology 
Geriatrics 
Hematology 
Immunology 
Obstetrics  6c  Gynecol 
Neurol  6c  Neurosurg 
Ophthalmology 
Orthopedics 
Arthritis  6c  Rheumat 
Otorhinolaryngology 
Pathology 
Pediatrics 
Pharmacology 
Pharmacy 
Psychiatry 
Radiology  6c  Nucl  Mea 
Respiratory  System 
Surgery 
Tropical  Medicine 
Urology 
Nephrology 
Veterinary  Medicine 
Hygiene  6c  Publ  Hlth 
BIO  MED  RESEARCH 
Physiology 
Anatomy  6c  Morphology 
Embryology 
Genetics  6c  Heredity 
Nutrition  &  Dietet 
Biochem  6c  Molec  Bio! 

Biophysics 
Cell  Biol  Cyt  6c'  Hist 
Microbiology 
Virology 
Parasitology 
Biomedical  Enginmg 
Misc  Biomedical  Res 
Genrl  Biomedical  Res 
BIOLOGY 


10045 

323 
608 

7958 

3859 

1481 

695 

4695 

530 

1001 

281 

1472 

7728 

969 

7250 

2320 

159 

404 

721 

2098 

2401 

3742 

1245 

254 

1772 

848 

2646 

290 

511 

109 

597 

607 

4830 

759 

965 

1352 

1056 

23754 

499 

3935 

2323 

3269 

751 

324 
417 

10198 

1195 


Percent 

0  10  20  30  40  50 


0  10  20  30  40  50 

Percent 


NOTE:  No  values  shown  for  scientific  subfields  with 
less  than  1  percent  of  papers  for  this  BID. 


30 


NIH  SUPPORT-SOURCE  INTERDEPENDENCY 


It  is  well  known  that  the  scientific  interests  of  individual  support 
sources  intersect  and  interact.  The  lay  public  and  even  some  scientists 
have  difficulty  comprehending  the  complexity  of  these  relations.  Diagrams 
may  be  helpful.  Figures  9  and  10  are  based  on  mapping  the  citation 
interaction  among  scientists  supported  by  various  sources.  Corresponding 
figures  in  the  other  reports  of  this  series  highlight  the  role  of  the 
individual  BIDs. 

Figure  9A,  based  on  the  references  listed  in  NIH-supported  papers, 
illustrates  the  dependence  of  NIH  research  on  information  supported  by  NIH 
and  non-NIH  sources.  Fifty-two  percent  of  the  references  in  NIH-supported 
papers  were  to  other  papers  supported  by  NIH,  and  48  percent  were  to  papers 
supported  by  others.  The  percent  of  NIH  references  to  each  of  the  BIDs  is 
largely  a  reflection  of  their  relative  sizes.  Thus,  NCI,  NHLBI ,  NIADDK ,  and 
NIGMS  receive  the  largest  share  of  NIH  references  to  NIH-supported  papers. 

The  papers  that  give  no  support  acknowledgements  are  likely  to  cite 
"clinical  observations" — i.e.,  practicing  physicians'  observations  of 
notable  experience  with  a  small  group  of  patients.  Eighteen  percent  of  the 
NIH  references  are  to  papers  of  foreign  (non-U. S. -supported)  scientists. 

Figure  9B  presents  the  converse  of  9A,  showing  the  citations  of 
NIH-supported  papers  according  to  the  referencing  sources.  Forty-six 
percent  of  the  citations  received  by  NIH-supported  papers  were  from  papers 
supported  by  NIH,  while  54  percent  were  from  papers  with  other  support. 
Again,  the  percent  of  NIH  citations  received  from  each  of  the  BIDs  largely 
reflects  its  relative  size.  NIH  receives  23.4  percent  of  its  citations  from 
foreign  papers. 

Clearly,  any  decisions  that  would  significantly  affect  the  programmatic 
structure  of  NIH  would  have  important  effects  on  a  worldwide  community  of 
investigators . 

Figure  10  represents  (a)  the  various  supporters  of  research  reported  in 
the  entire  journal  set,  with  the  areas  of  the  circles  proportional  to  the 
number  of  supported  papers,  and  (b)  citations  by  and  of  NIH-supported 
papers,  showing  the  same  percent  distributions  as  in  Figures  9A  and  9B. 
"Foreign,"  the  largest  circle,  represents  papers  by  authors  from  foreign 
institutions  who  acknowledged  no  U.S.  support.  Arrows  pointing  outward 
represent  references  by  NIH-supported  authors,  and  arrows  pointing  inward 
represent  citations  of  those  authors'  works. 
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Figure  9A 

PERCENT  DISTRIBUTION  OF  REFERENCES  IN  NIH-SUPPORTED  PAPERS,  1978-80, 
TO  PAPERS  SUPPORTED  BY  NIH  AND  OTHER  SOURCES,  1973-80 


OTHER  FED.  GOVT.  5.9% 

NSF  3.6%  — ^ 


'-NINCDS  3.6% 
'-NICHD  3.0% 


Figure  9B 

PERCENT  DISTRIBUTION  OF  CITATIONS  OF  SUPPORTED  PAPERS,  1973-80, 
IN  PAPERS  SUPPORTED  BY  NIH  AND  OTHER  SOURCES,  1978-80 


—  N I  AID  3.7% 


—  N I  NCOS  3.0% 
w-  NICHD  2.4% 


OTHER  FED.  GOVT. 


5.2%—^ 


NSF  2.6% 
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Figure  10 


UNIVERSE  OF  PUBLICATIONS  CITED  BY  AND  CITING 
NIH-SUPPORTED  PAPERS 

Area  of  Circles  Proportional  to  Number  of 
Publications  Supported;  Citations  by  Percent 
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PUBLICATION  PROFILE* 


Table  5A  is  a  profile  of  the  bibliometric  activity  of  NIH  for  the  period 
1973-76.  It  counts  all  papers  published  in  the  240  BID-MEDLINE  journal  set 
in  the  years  1973-76  and  counts  citations  received  by  these  papers  from  the 
275-journal  set  from  1973  through  1980. 


Similarly,  Table  5B  is  a  profile  of  NIH  for  the  period  1977-80. 


The  first  page  of  each  table  presents  the  data  for  all  fields  combined, 
for  each  research  level,  and  for  each  of  the  major  fields.  The  second  page 
lists  the  individual  subfields  of  clinical  medicine  and  biomedical 
research.  The  column  headings  are  defined  as  follows: 

1  Number  of  Papers  -  The  fractional  number  of  papers  supported  by 
NIH  in  the  particular  level,  field,  and  subfield  (L/F/S). 

2  Activity  Index  -  Proportion  of  NIH's  papers  in  the  L/F/S  divided 
by  the  proportion  of  all  papers  in  the  BID-MEDLINE  journal  set 
in  that  L/F/S. 

3  %  Internal  Effort  -  Percent  of  NIH's  papers  in  the  particular 
L/F/S. 


4  %  External  Effort  -  Percent  of  all  papers  in  the  BID-MEDLINE 
journal  set  in  the  particular  L/F/S  that  were  supported  by  NIH. 

5  Total  Cites  -  Total  citations  (from  all  journals  in  the 
BID-MEDLINE  set  for  citing  years  1973-80)  received  by  the  papers 
supported  by  NIH  in  the  particular  L/F/S.  Scaled  to  the  average 
citation  rate  for  each  L/F/S  in  1973. 

6  Cites  per  Paper  -  Total  scaled  citations  received  by  NIH's 
papers  in  a  given  L/F/S,  divided  by  the  number  of  papers 
supported . 

7  Cite  T-Score  -  NIH's  average  citations  per  paper  minus  the 
average  citations  per  paper  for  all  papers  in  the  particular 
L/F/S,  divided  by  the  standard  deviation  of  citations  per  paper 
for  all  papers  in  that  L/F/S.  The  statistic  is  scaled  to  a  mean 
of  50  and  a  standard  deviation  of  10. 

8  %  Papers  Among  the  Top  10%  -  Percent  of  NIH's  papers  in  the 
particular  L/F/S  that  are  among  the  10  percent  most  highly  cited 
papers  in  that  L/F/S. 


^Although  the  publication  profile  presents  analyses  for  any  number  of 
papers,  the  data  are  likely  to  be  unstable  when  based  on  aggregates  of  less 
than  25.  The  skewness  of  citation  distributions  permits  only  approximate 
statements  about  confidence  limits.  It  may  be  said,  however,  that  a  sample 
size  of  20  is  required  to  achieve  a  95  percent  confidence  interval  of  +2 
citations . 
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Table  5A 


B IBLI OMETRIC  PROFILE  OF  NIH- 
SUPPORTED  RESEARCH,  1973-76* 


CITES  %  PAPERS 


FIELD /LEVEL 

NUMBER 

PAPERS 

ACTIV 

INDEX 

%  INT 
EFFRT 

y.  EXT 
EFFRT 

TOTAL 

CITES 

PER 

PAPER 

CITE 

T-SCR 

AMONG 
TOP  10X 

XXXXXXXXXXXXXXXXXXXXXXXX 

NORMALIZED 

AGAINST 

FIELDS 

[1-2]  XXXXXXXXXXXXXXXXXXXXXXXX 

FIELDS  [1-2] 

59945. 

1.00 

100.00 

29.11 

852029 . 

14.2 

53.  15 

16.28 

CLIN  MEDICINE 

[  1] 

34232. 

0  .  95 

57.11 

27.61 

3957  14 . 

11.6 

54.69 

17.92 

BIOMED  RESEARCH 

[2] 

25711. 

1  .  08 

42.89 

3  1.38 

457  077  . 

17.8 

52.30 

15.50 

LEVEL 

CLINICAL-MIX  [1 

-2] 

14377  . 

0 .72 

23 . 98 

2  1.07 

137827  . 

9 . 6 

55.67 

19.53 

CLIN  INVESTIGATN 

[3] 

18250  . 

1  .  25 

30 .44 

36  .  35 

227478 . 

12.5 

53.64 

15.33 

BASIC  RESEARCH 

[4] 

27316. 

1  .07 

45.57 

3  1.22 

487059. 

17.8 

52.27 

15.08 

XXXXXXXXXXXXXXXXXXXXXXXX 

NORMALIZED 

AGAINST 

FIELDS 

[1-9]  XXXXXXXXXXXXXXXXXXXXXXXX 

FIELDS  [1-9] 

62421 . 

1.00 

100.00 

28.16 

865353. 

13.9 

53.32 

16.92 

CLIN  MEDICINE 

[1] 

34232  . 

0  .  98 

54.84 

27.61 

395714. 

11.6 

54.69 

17.92 

BIOMED  RESEARCH 

[2] 

25711. 

1.11 

4  1.19 

3  1.38 

457077 . 

17.8 

52 . 30 

15.50 

BIOLOGY 

[3] 

783  . 

0.60 

1  .  25 

16.83 

3829  . 

4  .  9 

52.24 

15.76 

CHEMISTRY 

[4] 

827  . 

0.80 

1  .  32 

22.59 

7879  . 

9 . 5 

53 . 36 

15.12 

PHYSICS 

[5] 

119. 

0  .  97 

0.19 

27 . 28 

865  . 

7  .  3 

55.27 

20.65 

EARTH  &  SPACE  SC 

[6] 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

ENGRNG  8  TECHNOL 

[7] 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

PSYCHOLOGY 

[8] 

748  . 

0  .  38 

1.20 

10.67 

33  14. 

4 . 4 

54.91 

21.14 

MATHEMATICS 

[9] 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

NOTE:  CHEMISTRY  AND  PSYCHOLOGY  DATA  SHOULD  BE  TREATED  CAUTIOUSLY  OVER  TIME  DUE  TO 
INCONSISTENT  DATABASE  COVERAGE. 


*BID-SCI  journal  set  citing  B ID -ME DL I NE 
papers,  1973-80.  Activity  index  normal¬ 
ized  against  Fields  1  and  2.  Citation 
counts  scaled  within  subfield  to  1973 
equi val ents. 
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Table  5A  (Continued) 


B IBLI OMETRIC  PROFILE  OF  NIH- 
SUPPORTED  RESEARCH,  1973-76* 


CITES  X  PAPERS 


NUMBER 

ACTIV 

X  INT 

%  EXT 

TOTAL 

PER 

CITE 

AMONG 

FIELD/SUBFIELD 

PAPERS 

INDEX 

EFFRT 

EFFRT 

CITES 

PAPER 

T-SCR 

TOP  10% 

CLIN  MEDICINE  [ 13 

GENRL  X  INTERNAL  MED 

54  15. 

1.00 

9.03 

29.10 

84240 . 

15.6 

56  .  18 

18.50 

ALLERGY 

147  . 

1.45 

0.24 

42.10 

1157. 

7  .  9 

5  1.24 

13.08 

ANESTHESIOLOGY 

367  . 

0.88 

0.6  1 

25.6  1 

230  1  . 

6.3 

56 .09 

22.82 

CANCER 

37  0  1  . 

1.68 

6.17 

49.00 

5  1296  . 

13.9 

52.29 

13.33 

CARDIOVASCULAR  SYSTM 

19  11. 

1.19 

3.19 

34.68 

29803  . 

15.6 

55 . 34 

16.30 

DENTISTRY 

726  . 

0.7  1 

1.21 

20.74 

3225. 

4 . 4 

54.91 

21.16 

DERMAT  X  VENERL  DIS 

366  . 

0  .  95 

0.6  1 

27.74 

1905  . 

5.2 

56.42 

19.78 

ENDOCRINOLOGY 

2273. 

1 .24 

3.79 

36 . 06 

33639 . 

14.8 

55.23 

14.75 

FERTILITY 

298. 

0.54 

0.50 

15.64 

1590  . 

5.3 

5  1.48 

14 . 92 

GASTROENTEROLOGY 

466  . 

0 . 98 

0 .78 

28.54 

497  1  . 

10.7 

56 . 96 

16.31 

GERIATRICS 

162. 

0.40 

0 . 27 

11.77 

557  . 

3.4 

56 . 97 

28.84 

HEMATOLOGY 

66  1  . 

1.01 

1.10 

29.26 

5702  . 

8 . 6 

53.77 

16.15 

IMMUNOLOGY 

3457  . 

1  .43 

5.77 

4  1.77 

59210. 

17.1 

53.64 

15.77 

OBSTETRICS  X  GYNECOL 

453. 

0 .50 

0.76 

14.49 

3549  . 

7.8 

54.4  1 

17.48 

NEUROL  X  NEUROSURG 

3420  . 

0  .  98 

5.70 

28.65 

41968. 

12.3 

5  1.98 

13.30 

OPHTHALMOLOGY 

1194. 

1 . 44 

1  .  99 

42.02 

6985  . 

5.9 

52.98 

15.62 

ORTHOPEDICS 

63. 

0.27 

0.10 

7.79 

392. 

6.3 

56 . 98 

22.13 

ARTHRITIS  X  RHEUMAT 

174  . 

0.8  1 

0.29 

23.62 

1  990  . 

11.4 

62.43 

2  1.86 

OTORHINOLARYNGOLOGY 

462  . 

0.82 

0.77 

23.74 

1636  . 

3.5 

53.35 

16.52 

PATHOLOGY 

1085  . 

1.29 

1.8  1 

37.4  1 

8411. 

7.8 

53.63 

15.6  1 

PEDIATRICS 

1134. 

0  .  95 

1 .89 

27.71 

8282. 

7.3 

54 . 92 

16.23 

PHARMACOLOGY 

1739. 

0.78 

2.90 

22.64 

19470. 

11.2 

52.53 

15.42 

PHARMACY 

6  19. 

0.70 

1.03 

20.38 

4052  . 

6.5 

54.16 

18.31 

PSYCHIATRY 

123. 

0.13 

0.2  1 

3.73 

794  . 

6.4 

53.67 

15.97 

RADIOLOGY  X  NUCL  MED 

909  . 

0.72 

1 . 52 

20.82 

5324  . 

5.9 

52.20 

14.67 

RESPIRATORY  SYSTEM 

384  . 

1.01 

0.64 

29.37 

3  177. 

8 . 3 

52.99 

16.31 

SURGERY 

1486  . 

0.57 

2.48 

16.49 

10662  . 

7.2 

54.74 

18.54 

TROPICAL  MEDICINE 

152. 

0  .  94 

0.25 

27.37 

635. 

4.2 

51.78 

14.79 

UROLOGY 

246  . 

0 .40 

0.41 

11.55 

1  0  90  . 

4 . 4 

53 . 38 

18.55 

NEPHROLOGY 

47  . 

0 . 55 

0  .  08 

15.98 

249. 

5 . 4 

51.85 

10.04 

VETERINARY  MEDICINE 

300  . 

0.52 

0.50 

15.02 

922. 

3  .  1 

5  1.42 

15.37 

ADDICTIVE  DISEASES 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

HYGIENE  X  PUBL  HLTH 

295. 

0.53 

0.49 

15.47 

1787  . 

6  .  1 

6  1.01 

27.77 

BIOMED  RESEARCH  [23 

PHYSIOLOGY 

2117. 

1  .  36 

3.53 

39.53 

31284. 

14.8 

5  1.02 

11.76 

ANATOMY  X  MORPHOLOGY 

388. 

1.65 

0 .65 

48.14 

2360  . 

6  .  1 

5  1.05 

13.23 

EMBRYOLOGY 

463. 

1.45 

0.77 

42.34 

5666  . 

12.2 

53.55 

14.54 

GENETICS  X  HEREDITY 

688  . 

0.91 

1  .  15 

26.55 

6829  . 

9.  9 

50.53 

11.78 

NUTRITION  X  DIETET 

442  . 

1  .  06 

0.74 

30.8  1 

3608  . 

8.2 

55.52 

15.81 

BIOCHEM  X  MOLEC  BIOL 

11226. 

1  .07 

18.73 

3  1.06 

2  14266  . 

19.1 

5  1.83 

15.02 

BIOPHYSICS 

198. 

1.12 

0 .33 

32.62 

1738. 

8.8 

55.40 

17.26 

CELL  BIOL  CYT  X  HIST 

1855. 

1  .  17 

3.10 

34.15 

32892. 

17.7 

53.19 

16.41 

MICROBIOLOGY 

1233  . 

0.86 

2.06 

25.13 

12345. 

10.0 

54 . 34 

17.39 

VIROLOGY 

1485  . 

1  .40 

2.48 

40.74 

30308. 

20 . 4 

54.17 

14.80 

PARASITOLOGY 

434  . 

1.01 

0 .72 

29.37 

1694  . 

3.9 

53.25 

17.88 

BIOMEDICAL  ENGINRNG 

160  . 

1.09 

0.27 

3  1.68 

490  . 

3.  1 

55.11 

17.33 

MISC  BIOMEDICAL  RES 

219. 

1.09 

0 . 37 

31.7  1 

457  . 

2.  1 

51.79 

15.69 

GENRL  BIOMEDICAL  RES 

4804  . 

0  .  96 

8.01 

27.82 

115314. 

24 . 0 

54.22 

16  .  98 
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Table  5B 


BIBLIOMETRIC  PROFILE  OF  NIH- 
SUPPORTED  RESEARCH,  1977-80* 


FIELD/LEVEL 

NUMBER 

PAPERS 

ACTIV 

INDEX 

X  INT 
EFFRT 

%  EXT 
EFFRT 

TOTAL 

CITES 

CITES 

PER 

PAPER 

CITE 

T-SCR 

X  PAPERS 
AMONG 
TOP  10X 

XXXXXXXXXXXXXXXXXXXXXXXX 

NORMALIZED 

AGAINST 

FIELDS 

[1-23  xxxxxxxxxxxxxxxxxxxxxxxx 

FIELDS  [1-21 

64113. 

1.00 

100.00 

27 . 95 

447666  . 

14.1 

54.21 

17.37 

CLIN  MEDICINE 

[  1] 

35390 . 

0  .90 

55 .20 

25 . 22 

208123. 

11.8 

55.68 

19.62 

BIOMED  RESEARCH 

[23 

2872  1  . 

1  .  15 

44.80 

32.25 

237624 . 

17 . 0 

53.05 

14.88 

LEVEL 

CLINICAL-MIX  [1 

-23 

13626 . 

0.63 

2  1.25 

17.69 

7  0  0  05  . 

9  .  9 

55.86 

22 . 05 

CLIN  INVESTIGATN 

[33 

19601. 

1 .23 

30.57 

34.51 

120  12  1  . 

12.5 

54.78 

15.79 

BASIC  RESEARCH 

[43 

30882. 

1.16 

48.17 

32 .30 

254503 . 

16.9 

52.95 

14.63 

xxxxxxxxxxxxxxxxxxxxxxxx 

NORMALIZED 

AGAINST 

FIELDS 

[1-93  xxxxxxxxxxxxxxxxxxxxxxxx 

FIELDS  [1-93 

65688 . 

1.00 

100.00 

27.45 

44579  1 . 

13.7 

54.3  1 

18.03 

CLIN  MEDICINE 

[  13 

35390 . 

0 . 92 

53.88 

25.22 

208123. 

11.8 

55.68 

19.62 

BIOMED  RESEARCH 

[23 

28721. 

1.17 

43.72 

32.25 

237624 . 

17.0 

53.05 

14.88 

BIOLOGY 

[33 

4  12. 

0 . 48 

0.63 

13.20 

1257  . 

5.  1 

52 . 99 

20 . 96 

CHEMISTRY 

[43 

463  . 

0.60 

0.70 

16 .58 

3  114. 

10.1 

54.05 

17.43 

PHYSICS 

[53 

162  . 

1.41 

0 .25 

38.84 

465  . 

5.9 

52.44 

14.59 

EARTH  &  SPACE  SC 

[63 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

ENGRNG  8  TECHNOL 

[73 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

PSYCHOLOGY 

[83 

538  . 

0 .55 

0.82 

15.08 

1  184  . 

4 . 3 

54.40 

22.  18 

MATHEMATICS 

[93 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

NOTE:  CHEMISTRY  AND  PSYCHOLOGY  DATA  SHOULD  BE  TREATED  CAUTIOUSLY  OVER  TIME  DUE  TO 
INCONSISTENT  DATABASE  COVERAGE. 


*BID-SCI  journal  set  citing  BID -MEDL I NE 
papers,  1973-80,  but  does  not  include  ci¬ 
tations  received  by  1979-80  publications. 
Activity  index  normalized  against  Fields  1 
and  2.  Citation  counts  scaled  within  sub¬ 
field  to  1973  equivalents. 
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Table  5B  (Continued) 


B IBLIOMETRIC  PROFILE  OF  N I H - 
SUPPORTED  RESEARCH,  1977-80* 


CITES  *  PAPERS 


NUMBER 

ACTIV 

%  INT 

%  EXT 

TOTAL 

PER 

CITE 

AMONG 

FIELD/SUBFIELD 

PAPERS 

INDEX 

EFFRT 

EFFRT 

CITES 

PAPER 

T  -SCR 

TOP  10X. 

CLIN  MEDICINE  [  1  ] 

GENRL  X  INTERNAL  MED 

46  30  . 

0.86 

7 . 22 

24.13 

41909. 

17.2 

57 .24 

20.31 

ALLERGY 

177  . 

1  .  34 

0 . 28 

37.59 

720  . 

8 . 7 

53.55 

16.16 

ANESTHESIOLOGY 

24  2  . 

0.64 

0  .  38 

17 .88 

784  . 

7  .  1 

59.00 

25 .68 

CANCER 

4257  . 

1  .59 

6  .64 

44.31 

30045 . 

13.6 

52 .55 

13.07 

CARDIOVASCULAR  SYSTM 

1  94  9  . 

1  .  18 

3  .  04 

33  .  04 

14874 . 

15.3 

56 . 08 

17.07 

DENTISTRY 

755  . 

0  .  74 

1  .  18 

20 . 75 

16  12. 

4  .  1 

53.11 

20  .  37 

DERMAT  8  VENERL  DIS 

329  . 

0.73 

0.51 

20 .40 

859  . 

5.8 

55.74 

28.49 

ENDOCRINOLOGY 

2422  . 

1  .29 

3 .78 

36.17 

16254  . 

15.3 

58.25 

16.18 

FERTILITY 

232  . 

0 .45 

0  .  36 

12.65 

654  . 

5.5 

5  1.51 

18.04 

GASTROENTEROLOGY 

535  . 

0  .  96 

0 .83 

26 .75 

3054  . 

10.5 

63.99 

16.35 

GERIATRICS 

120  . 

0  .  38 

0.19 

10.69 

23  1  . 

4 . 5 

62.42 

26.69 

HEMATOLOGY 

8  11. 

1.12 

1  .27 

3  1.29 

3048  . 

8.8 

63.15 

17.26 

IMMUNOLOGY 

427  1  . 

1  .45 

6  .66 

40.50 

34324 . 

16.1 

56.09 

14.97 

ODSTETRICS  X  GYNECOL 

5  16. 

0 . 54 

0.81 

15.19 

2  147. 

8 . 3 

55 . 32 

22.84 

NEUROL  X  NEUROSURG 

383  1  . 

0  .  95 

5  .  97 

26.51 

23506  . 

12.2 

53.2  1 

13.77 

OPHTHALMOLOGY 

1126. 

1  .  32 

1.76 

36.91 

3  147. 

6  .  1 

52.94 

15.66 

ORTHOPEDICS 

97  . 

0 .23 

0.15 

6  .  33 

174  . 

5 . 4 

53.36 

18 . 56 

ARTHRITIS  8  RHEUMAT 

23  1  . 

0.79 

0  .  36 

22.14 

906  . 

10.5 

54.63 

22 . 93 

OTORHINOLARYNGOLOGY 

259  . 

0  .  47 

0.40 

13.00 

655  . 

4 . 2 

54.14 

18 . 57 

PATHOLOGY 

10  13. 

1.21 

1  .  58 

3  3.69 

4  0  0  1  . 

8.2 

56 .55 

18.63 

PEDIATRICS 

1267  . 

0.86 

1  .  98 

24.00 

4772  . 

7  .7 

55.21 

19.89 

PHARMACOLOGY 

20  04  . 

0  .77 

3.12 

2  1.55 

90  0  3  . 

9.8 

5  1.11 

11.80 

PHARMACY 

626  . 

0 .72 

0  .  98 

20 .06 

2389  . 

6 .8 

54 . 94 

20 .27 

PSYCHIATRY 

13  1. 

0.14 

0.20 

3.79 

582  . 

8  .  1 

58.15 

22.17 

RADIOLOGY  8  NUCL  MED 

863  . 

0  .  54 

1  .  35 

15.15 

2805  . 

5  .  9 

5  1.91 

18.00 

RESPIRATORY  SYSTEM 

464  . 

1  .  28 

0 .72 

35.71 

1882  . 

8 . 2 

6  1.36 

18.60 

SURGERY 

1160. 

0.45 

1.8  1 

12.58 

4744  . 

7  .  3 

54.31 

20.21 

TROPICAL  MEDICINE 

137  . 

0.70 

0.21 

19.54 

36  1  . 

4  .  9 

53.61 

14  .67 

UROLOGY 

26  5. 

0.39 

0.41 

10.90 

764  . 

5.2 

55.26 

2  1.96 

NEPHROLOGY 

63  . 

0.50 

0.10 

14.11 

13  1. 

3.6 

48 . 94 

14.93 

VETERINARY  MEDICINE 

297  . 

0  .  38 

0 .46 

10.59 

505  . 

3 . 4 

52 . 57 

15.62 

ADDICTIVE  DISEASES 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

HYGIENE  8  PUBL  HLTH 

3  13. 

0.7  1 

0.49 

19.92 

933  . 

6  .  0 

60.4  1 

38.63 

BIOMED  RESEARCH  [23 

PHYSIOLOGY 

27  14. 

1.51 

4.23 

42  .  18 

18683 . 

14.7 

5  1.36 

12.08 

ANATOMY  X  MORPHOLOGY 

37  1  . 

1  .64 

0 . 58 

45.97 

1234  . 

6.2 

5  1.84 

17.75 

EMBRYOLOGY 

502  . 

1  .  35 

0  .  78 

37 .85 

2849  . 

11.5 

55  .  90 

15.20 

GENETICS  X  HEREDITY 

665  . 

0 .86 

1.04 

24 . 04 

30  99. 

9  .  9 

52.45 

16.56 

NUTRITION  8  DIETET 

6  14. 

0  .  97 

0  .  96 

27 .24 

24  0  0  . 

7.7 

52.62 

14.78 

BIOCHEM  X  MOLEC  BIOL 

12527  . 

1.11 

19.54 

30  .  93 

1  1  1233  . 

18 . 6 

53.40 

15.18 

BIOPHYSICS 

30  1  . 

1  .20 

0  .47 

33.67 

997  . 

8  .  1 

52 .53 

13.  18 

CELL  BIOL  CYT  X  HIST 

207  9  . 

1  .25 

3 .24 

34 .82 

17959. 

17.5 

56.39 

16.93 

MICROBIOLOGY 

1  0  90  . 

0.90 

1.70 

25.17 

4565  . 

8 . 8 

53.50 

15.30 

VIROLOGY 

1783  . 

1.52 

2 . 78 

42 . 37 

16735 . 

19.3 

6  1.04 

14.33 

PARASITOLOGY 

3  18. 

0 .82 

0 .50 

23.03 

734  . 

3 . 7 

52 .23 

14.06 

BIOMEDICAL  ENGINRNG 

165. 

0  .  98 

0  .26 

27 .35 

285  . 

3.2 

55.72 

29.26 

MISC  BIOMEDICAL  RES 

198. 

1.14 

0.31 

3  1.98 

243. 

2.2 

5  1.96 

16.57 

GENRL  BIOMEDICAL  RES 

5394  . 

1.14 

8.41 

3  1.78 

5752  1  . 

2  1.2 

53.70 

14.73 
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CROSSCUTTING  RESEARCH 


Table  6  opens  a  small  window  on  the  breadth  of  relations  between 
biomedical  disciplines  and  the  programmatic  interests  of  NIH.  Shown  in  the 
table  are  the  clinical  medical  fields  and  basic  bioscience  disciplines  that 
were  substantially  supported  by  more  than  one  NIH  Institute,  as  reflected  in 
1973-76  and  1977-80  publications.  Seventy-five  papers  in  either  time  period 
is  the  arbitrary  minimum  number  of  papers  used  here  to  define  substantial 
involvement.  Publication  counts  for  each  discipline  and  BID  show  changes  of 
research  emphasis  over  time. 

For  the  following  15  other  disciplines,  only  one  BID  each  was 
substantially  involved.  The  Institute  and  number  of  papers  in  each  period, 
1973-76/1977-80,  are  shown  parenthetically. 


Allergy  ( NIAID — 98/106  papers) 

Anesthesiology  (NIGMS — 230/143  papers) 
Cardiovascular  System  (NHLBI — 1,626/1,661  papers) 
Dentistry  (NIDR — 554/574  papers) 

Fertility  (NICHD — 198/160  papers) 

Gastroenterology  ( NIADDK — 298/347  papers) 
*Geriatrics  (NICHD  +  NIA — 71  +  17/13  +  67  papers) 
Ophthalmology  (NEI — 995/994  papers) 

Arthritis  and  Rheumatism  (NIADDK — 109/127  papers) 
Otorhinolaryngology  (NINCDS — 345/159  papers) 
Respiratory  System  (NHLBI — 253/347  papers) 
Tropical  Medicine  (NIAID — 120/108  papers) 

Hygiene  and  Public  Health  (NHLBI — 49/81  papers) 
Anatomy  and  Morphology  (NICHD — 88/83  papers) 
Parasitology  (NIAID — 352/231  papers) 


The  fields  and  disciplines  that  have  been  most  widely  influenced  by  NIH 
programmatic  interests — i.e.,  four  or  more  of  the  Institutes  supported  a 
substantial  number  of  papers — are  as  follows: 


General  and  Internal  Medicine 
Cancer 

Endocrinology 

Immunology 

Neurology  and  Neurosurgery 

Pathology 

Pediatrics 


Pharmacology 

Surgery 

Physiology 

Biochemistry  and  Molecular 


Biology 

Cell  Biology,  Cytology, 


and  Histology 
Microbiology 


Not  surprisingly,  all  the  BIDs  supported  a  substantial  number  of  papers 
in  the  subfield  Biochemistry  and  Molecular  Biology. 


^Following  the  creation  of  NIA  in  1974,  most  of  the  Geriatrics  research 
formerly  sponsored  by  NICHD  was  subsequently  transferred  to  the  new 
Institute.  Hence,  publication  counts  in  this  subfield  for  NIA  and  NICHD  are 
presented  together  here. 
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N1A  was  created  in  1974  and  had  few  papers  during  1973-76. 
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PART  II.  NIH  INTRAMURAL  PROGRAM 


Part  I  of  this  report  presented  a  bibliometric  analysis  of  all 
NIH-supported  publications  —  intramural  and  extramural.  This  section  focuses 
on  the  publications  resulting  from  the  NIH  Intramural  Research  Program. 

This  program  yields  approximately  10  percent  of  all  NIH-supported 
publications,  varying  across  the  individual  BIDs.  Funding  for  these 
programs  as  a  percent  of  the  BID'S  total  budget  ranges  from  less  than  1  for 
NIGMS  to  nearly  30  for  NIEHS.  Table  7  presents  obligations  data  for  the 
individual  Institutes. 

The  other  tables  and  figures  in  this  part  of  the  report  parallel  those 
in  Part  I. 


Table  7 


Allocation  of  Individual  BIDs'  Fiscal  1980  Obligations 
to  the  Intramural  Research  Program* 

(Dollars  in  Thousands) 


Total  Intramural 


BID 

Obligations 

Research 

Percent 

NIA 

$  69,687 

$  12,670 

18.2% 

NIAID 

214,657 

37,108 

17.3 

NIADDK 

340,131 

40,387 

11.9 

NCI 

998,047 

144,009 

14.4 

NICHD 

208,346 

21,593 

10.4 

NIDR 

67,600 

13,039 

19.3 

NIEHS 

83,637 

24,897 

29.8 

NEI 

109,603 

10,192 

9.3 

NIGMS 

312,339 

515 

0.2 

NHLBI 

527,091 

39,040 

7.4 

NINCDS 

241  ,353 

34,473 

14.3 

*Data  from  "Basic  Data  Relating  to  the  National  Institutes  of  Health, 
1981,"  NIH  Publication  No.  81-1261,  May  1981,  pp.  12-17. 
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INTRAMURAL  FUNDING  AND  PUBLICATION  TRENDS 


As  in  the  NIH  overall  program,  analysis  of  intramural  data  reveals  a 
strong  association  of  funding  and  publication  trends.  The  correlation 
between  intramural  research  obligations  in  constant  (fiscal  1969)  dollars, 
1967-77,  and  numbers  of  research  papers  published  three  years  later  (Fields 
1-9)  proved  substantial:  r  =  .93.  The  two  series  are  as  follows: 


Fiscal 

Constant  $ 

Fiscal 

No.  of 

Year 

(Thousands) 

Year 

Papers 

1967 

$  95,231 

1970 

1,285 

1968 

100,425 

1971 

1,326 

1969 

104,473 

1972 

1 ,417 

1970 

102,640 

1973 

1,348 

1971 

116,250 

1974 

1,379 

1972 

118,408 

1975 

1,427 

1973 

120,518 

1976 

1 ,462 

1974 

127,417 

1977 

1,542 

1975 

137,786 

1978 

1,598 

1976 

143,320 

1979 

1,766 

1977 

160,089 

1980 

1,672* 

*Approximately  5 

percent  short  of  total 

papers . 
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INTRAMURAL  PUBLICATION  ACTIVITY 


A  research-level  profile  of  papers  derived  from  the  NIH  Intramural 
Research  Program  (IRP)  is  presented  in  Table  8,  and  publication  profiles 
showing  the  areas  of  NIH  IRP  research  emphasis  are  presented  in  Figures  11A, 
1 1 B,  12A,  and  12B.  These  figures  are  constructed  directly  from  the  data  in 
Tables  9A  and  B. 


Research-Level  Profile 


Table  8  presents  the  level  classification  of  the  NIH  IRP  publications 
for  two  time  periods,  1973-76  and  1977-80.  There  was  a  decrease  in  the 
percent,  but  not  the  number,  of  IRP  papers  at  the  more  clinical  levels 
(Levels  1  and  2)  and  an  increase  in  the  number  and  percent  of  IRP  papers  at 
the  more  basic  levels— Cl inical  Investigation  (Level  3)  and  Basic  Research 
(Level  4).  These  trends  closely  parallel  those  noted  in  the  total  NIH 
supported  papers  (intramural  and  extramural)  in  Table  3. 


Table  8 

Number  and  Percent  of  NIH  Intramural  Research  Papers 
According  to  Level,  1973-76  and  1977-80 


Level   1973-76   1977-80* 


Levels  1  &  2 

(Clinical  Observation 


&  Clinical  Mix) 

1,209 

22% 

1,273 

19% 

Level  3 

(Clinical  Investigation) 

1 ,887 

34 

2,300 

35 

Level  4  (Basic  Research) 

2,425 

44 

3,020 

46 

Total 

5,521 

100% 

6,593 

100% 

*1980  data  include  a  5  percent  estimate  for  1980  papers  appearing  on  1981 
SCI  tapes. 
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Publication  Counts 


Figures  1 1 A  and  11B  show  the  percent  of  all  papers  in  clinical  medicine 
and  biomedical  research,  respectively,  in  the  BID-MEDLINE  journal  set  that 
were  supported  by  NIH.  For  each  subfield,  the  two  sets  of  bars  represent 
NIH-supported  papers  as  a  percent  of  all  papers  in  the  subfield,  1973-76  and 
1977-80.  All  papers  acknowledging  NIH  support,  intramural  or  extramural, 
are  indicated  by  the  total  bar;  those  acknowledging  IRP  support,  by  the  dark 
portion. 

The  areas  in  which  NIH  plays  the  largest  role— i.e.,  greatest  relative 
emphasis — are  Cancer,  Immunology,  and  Virology.  This  emphasis  reflects  the 
large  roles  of  the  National  Cancer  Institute  and  the  National  Institute  of 
Allergy  and  Infectious  Diseases,  the  first  in  all  three  areas  and  the  second 
in  Immunology  and  Virology.  The  IRP  as  well  as  NIH  altogether  is  a  major 
force  in  these  three  subfields. 


Activity  Indexes 

Figures  12A  and  12B  show  the  activity  index  distribution  for  the  IRP  at 
the  two  periods  1973-76  and  1977-80.  A  fuller  description  of  the  activity 
index  is  provided  on  page  16. 

The  IRP  activity  index  in  Cancer,  at  3.3  for  1973-76  and  2.8  for  1977-80 
(or  3.3  and  2.8  times  the  "expected"  level,  given  the  size  of  the  IRP  and 
the  size  of  the  field),  is  the  program's  subfield  of  greatest  relative 
emphasis.  Note  that  the  index  for  Cancer  declined  in  the  second  period, 
though  the  number  of  IRP  papers  in  the  subfield  actually  increased.  This  is 
because  the  subfield  grew  faster  than  the  IRP  participation. 

The  IRP's  activity  indexes  are  high  in  the  subfields  of  Immunology  and 
Virology.  During  1977-80  the  IRP  increased  its  absolute  and  relative 
activity  in  these  areas. 

The  indexes  are  also  high  for  certain  subfields,  represented  by  open 
bars,  that  contained  very  few  of  the  papers  acknowledging  IRP  support,  such 
as  Tropical  Medicine,  Embryology,  and  Miscellaneous  Biomedical  Research. 
While  NIH  does  not  emphasize  these  subfields,  the  research  is  important  to 
sustain  and  advance  areas  not  attractive  to  many  investigators. 
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Figure  11A 

NIH  Intramural  and  Total  NIH 

Percent  of  All  Papers  in 
Each  Subfield  of  Clinical  Medicine 


240  B1D-MEDLINE  Journals 


SCIENTIFIC  FIELD  Number 
Subfield  of 
Papers 

CLINICAL  MEDICINE 


Genrl  <3 c  Internal  Med 
Aliergy 
Anesthesiology 
Cancer 

Cardiovascular  Systm 
Dentistry 
Dermat  6c  Venerl  Dis 
Endocrinology 
Fertility 
Gastroenterology 
Geriatrics 
Hematology 
Immunology 
Obstetrics  6c  Gynecol 
Neurol  6c  Neurosurg 
Ophthalmology 
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16 

5 
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Figure  11A  (Continued) 


SCIENTIFIC  FIELD 
Subfield 

CLINICAL  MEDICINE 
Orthopedics 
Arthritis  Sc  Rheumat 
Otorhinolaryngology 
Pathology 
Pediatrics 
Pharmacology 
Pharmacy 
Psychiatry 
Radiology  Sc  Nucl  Med 
Respiratory  System 
Surgery 
Tropical  Medicine 
Urology 
Nephrology 
Veterinary  Medicine 
Hygiene  Sc  Publ  Hlth 


NIH  Intramural  and  Total  NIH 

Percent  of  All  Papers  in 
Each  Subfield  of  Clinical  Medicine 
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Figure  1  IB 

NIH  Intramural  and  Total  NIH 

Percent  of  All  Papers  in 
Each  Subfield  of  Biomedical  Research 
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Figure  12A 

NIH  Intramural  Activity  Indexes  in 
Subfields  of  Clinical  Medicine 
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Note:  Open  bars  designate  subfields  that  contained  less  than  1  percent 
of  the  papers  by  intramural  NIH  authors  in  the  given  period. 
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Figure  12A  (Continued) 

NIH  Intramural  Activity  Indexes  in 
Subfields  of  Clinical  Medicine 
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Figure  12B 


NIH  Intramurai  Activity  Indexes  in 
Subfields  of  Biomedical  Research 
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CITATION  PERFORMANCE  OF  INTRAMURAL  PAPERS 


It  is  widely  accepted  within  the  research  community  that  high  citation 
rates  are  associated  with  quality  research,  especially  when 

•  statistically  meaningful  numbers  of  papers  are  under 
scrutiny,  and 

•  adequate  normalization  is  supplied,  to  take  account  of 
differences  between  citation  density  in  different  subfields 
and  periods. 

Also  widely  accepted  is  the  view  that  the  very  highly  cited  papers  play 
a  particularly  important  role  in  research  advance. 

Within  the  240-journal  database, 

•  26.1  percent  of  the  NIH  intramural  papers  are  in  the 
top  citation  decile, 

•  16.3  percent  of  NIH-supported  extramural  papers  are  in 
this  decile, 

•  11.7  percent  of  all  other  U.S. -supported  papers  are  in 
the  decile,  and 

t  only  3.9  percent  of  the  U.S.  papers  that  do  not  acknowl¬ 
edge  support  are  in  the  decile. 

A  paper  is  placed  in  the  top  citation  decile  if  it  is  cited  at  least  as 
frequently  as  the  most  frequently  cited  10  percent  of  all  papers  in  the 
field  or  subfield.  For  example,  if  11  percent  of  the  papers  in  a  subfield 
are  cited  more  than  five  times  in  a  given  year,  then  any  paper  cited  more 
than  five  times  in  that  year  would  be  considered  a  "top  decile"  paper. 

Since  citation  counts  are  integer,  the  top  decile  always  contains  slightly 
more  than  10  percent  of  the  papers.  For  example,  10.64  percent  of  the 
papers  in  the  entire  database  taken  together  are  in  the  top  decile. 

The  outstanding  performance  of  the  NIH  intramural  program  is  clearly 
apparent.  More  than  two  and  one-half  times  as  many  NIH  intramural  papers 
are  in  the  top  10  percent  of  cited  papers  in  biomedicine  as  one  would 
expect.  Also,  the  citation  performance  of  the  NIFI-supported  extramural 
papers  is  excellent,  with  60  percent  more  papers  in  the  top  decile  then  one 
would  expect. 

At  the  other  end  of  the  citation  spectrum  are  the  papers  designated  U.S. 
unacknowledged  support  -papers  that  did  not  have  any  kind  of  research 
support  acknowledgement.  These  are  usually  clinical  observation  papers, 
written  by  a  physician  or  other  scientist  without  any  outside  funding.  Only 
one-third  as  many  of  these  are  in  the  top  decile,  an  indication  that  they 
are  generally  not  in  the  mainstream  of  biomedical  research. 
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Subfield  Basis 


The  outstanding  intramural  publication  record  is  not  confined  to  any  one 
subfield,  but  is  virtually  across  the  board.  High  citation  counts  are  found 
in  all  the  subfields  in  which  NIH  intramural  papers  are  published.  Before 
discussing  the  subfield  results,  a  subtle  point  about  the  data  should  be 
clarified. 

When  top  decile  is  defined  on  a  subfield-by-subfield  basis,  the  citation 
cutoff  is  different  in  each  subfield.  As  a  result,  the  average  top  decile 
percentages  are  slightly  different  from  the  ones  previously  given  for  all 
subfields  combined.  Specifically,  within  the  240  biomedical  journals  in  our 
B I D-MEDL I NE  database,  on  a  subfield-by-subfield  basis, 

•  21.9  percent  of  the  NIH  intramural  papers  are  in  the  top 
citation  deciles  of  their  subfields, 

»  15.3  percent  of  the  NIH-supported  extramural  papers  are  in 
these  top  citation  deciles, 

•  12.4  percent  of  all  U.S. -authored  and  U.S. -supported  papers 
are  in  these  deciles,  and 

•  only  7.3  percent  of  the  U.S.  papers  with  support  unacknowledged 
are  in  these  deciles. 

The  fact  that  the  NIH  intramural  performance  is  not  quite  as  high  on  a 
subfield-by-subfield  basis,  and  the  support-unacknowledged  performance  not 
quite  as  poor,  are  results  of  an  interesting  aspect  of  the  data:  NIH 
intramural  papers  are  being  published  in  the  most  highly  cited  subfields; 
the  support-unacknowledged  papers,  in  the  least  highly  cited.  As  a  result, 
a  subfield-by-subfield  comparison,  while  catching  the  breadth  of  the  NIH 
performance,  tends  to  underestimate  the  impact  of  these  papers  on 
biomedicine  as  a  whole. 

Figure  13  presents  citation  performance  data  for  NIH  intramural  program 
publications  subfield  by  subfield. 

There  are  18  biomedical  subfields  in  which  the  NIH  intramural  program 
publishes  more  than  one  percent  of  its  papers.  In  17  of  these  subfields, 
substantially  more  than  10  percent  of  the  papers  are  in  the  top  decile.  In 
only  one  subfield — Genetics  and  Heredity — is  this  not  quite  true.  In  the 
other  17  subfields,  15  percent  or  more  of  the  NIH  intramural  papers  are  in 
the  top  decile,  and  in  General  and  Internal  Medicine  and  Ophthalmology,  an 
almost  incredible  30  percent  of  the  NIH  intramural  papers  are  in  the  top 
decile  of  cited  papers. 
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Figure  13 
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INTRAMURAL  PUBLICATION  PROFILE 


Just  as  Tables  5A  and  B  presented  bibliometric  data  for  all  NIH 
programs,  Tables  9A  and  B  are  profiles  of  the  bibliometric  activity  of  the 
NIH  Intramural  Research  Program  (IRP).*  Table  9A  counts  all  papers 
published  in  the  240  BID-MEDLINE  journal  set  in  the  years  1973-76  and  counts 
citations  received  by  these  papers  from  the  275-journal  set  from  1973 
through  1980.  Table  9B  is  a  profile  of  the  NIH  IRP  for  the  period  1977-80. 

The  first  page  of  each  table  presents  the  data  for  all  fields  combined, 
for  each  research  level,  and  for  each  of  the  major  fields.  The  second  page 
lists  the  individual  subfields  of  clinical  medicine  and  biomedical 
research.  The  column  headings,  as  in  Tables  5A  and  B,  are  defined  as 
follows: 

1  Number  of  Papers  -  The  fractional  number  of  papers  supported  by 
this  BID  in  the  particular  level,  field,  and  subfield  (L/F/S). 

2  Activity  Index  -  Proportion  of  the  BID'S  papers  in  the  L/F/S 
divided  by  the  proportion  of  all  papers  in  the  BID-MEDLINE 
journal  set  in  that  L/F/S. 

3  %  Internal  Effort  -  Percent  of  the  BID'S  papers  in  the 
particular  L/F/S. 

4  %  External  Effort  -  Percent  of  all  papers  in  the  BID-MEDLINE 
journal  set  in  the  particular  L/F/S  that  were  supported  by  this 
BID. 

5  Total  Cites  -  Total  citations  (from  all  journals  in  the 
BID-MEDLINE  set  for  citing  years  1973-80)  received  by  the  papers 
supported  by  this  BID  in  the  particular  L/F/S.  Scaled  to  the 
average  citation  rate  for  each  L/F/S  in  1973. 

6  Cites  per  Paper  -  Total  scaled  citations  received  by  this  BID'S 
papers  in  a  given  L/F/S,  divided  by  the  number  of  papers 
supported . 

7  Cite  T-Score  -  This  BID'S  average  citations  per  paper  minus  the 
average  citations  per  paper  for  all  papers  in  the  particular 
L/F/S,  divided  by  the  standard  deviation  of  citations  per  paper 
for  all  papers  in  that  L/F/S.  The  statistic  is  scaled  to  a  mean 
of  50  and  a  standard  deviation  of  10. 

8  %  Papers  Among  the  Top  10%  -  Percent  of  this  BID'S  papers  in  the 
particular  L/F/S  that  are  among  the  10  percent  most  highly  cited 
papers  in  that  L/F/S. 


*Again,  the  data  are  likely  to  be  unstable  when  based  on  aggregates  of 
less  than  25.  Because  of  skewness  of  citation  distributions,  a  sample  size 
of  20  is  required  to  achieve  a  95  percent  confidence  interval  of  +2 
citations . 
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Table  9  A 


BIBLIOMETRIC  PROFILE  OF  NIH 
INTRAMURAL  RESEARCH,  1973-76* 


CITES  %  PAPERS 


FIELD /LEVEL 

NUMBER 

PAPERS 

ACTIV 

INDEX 

X  INT 
EFFRT 

X  EXT 
EFFRT 

TOTAL 

CITES 

PER 

PAPER 

CITE 

T-SCR 

AMONG 
TOP  10X 

XXXXXXXXXXXXXXXXXXXXXXXX 

NORMALIZED 

AGAINST 

FIELDS 

[1-2]  XXXXXXXXXXXXXXXXXXXXXXXX 

FIELDS  [1-2] 

552  1  . 

1.00 

100.00 

2 .68 

104466. 

18.9 

56 .86 

23.73 

CLIN  MEDICINE 

[  1] 

3  198. 

0  .  96 

57 . 93 

2.58 

48973. 

15.3 

59.42 

25 . 78 

BIOMED  RESEARCH 

[2] 

2323  . 

1  .  06 

42.07 

2.83 

55597  . 

23 . 9 

55.88 

23.89 

LEVEL 

CLINICAL-MIX  [1 

-2] 

120  9  . 

0.66 

2  1.89 

1.77 

15642 . 

12.9 

60.95 

27 . 08 

CLIN  INVESTIGATN 

[3] 

1887  . 

1  .40 

34  .  18 

3.76 

30751. 

16.3 

58.19 

22 .52 

BASIC  RESEARCH 

[  A  ] 

2425  . 

1.03 

43.93 

2.77 

58043 . 

23.9 

55.88 

23.54 

xxxxxxxxxxxxxxxxxxxxxxxx 

NORMALIZED 

AGAINST 

FIELDS 

[1-9]  XXXXXXXXXXXXXXXXXXXXXXXX 

FIELDS  [1-9] 

56  16. 

1.00 

100.00 

2.53 

104955 . 

18.7 

57 . 23 

24 . 93 

CLIN  MEDICINE 

[  1] 

3  198. 

1  .02 

56 . 95 

2.58 

48973 . 

15.3 

59.42 

25 . 78 

BIOMED  RESEARCH 

[2] 

2323. 

1.12 

4  1.36 

2.83 

55597  . 

23  .  9 

55.88 

23.89 

BIOLOGY 

[3] 

33. 

0 . 28 

0 . 58 

0.7  1 

168  . 

5.  1 

52.83 

19.29 

CHEMISTRY 

[4] 

49  . 

0 . 53 

0 .87 

1  .  34 

573  . 

11.7 

57.39 

23.  13 

PHYSICS 

[5] 

1  . 

0.09 

0  .  02 

0.23 

1  . 

1  .  0 

40.80 

0.00 

EARTH  l  SPACE  SC 

[6] 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

ENGRNG  &  TECHNOL 

[7] 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

PSYCHOLOGY 

[81 

12  . 

0  .  07 

0.21 

0.17 

44  . 

3 . 6 

52.58 

25.00 

MATHEMATICS 

[9] 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

NOTE:  CHEMISTRY  AND  PSYCHOLOGY  DATA  SHOULD  BE  TREATED  CAUTIOUSLY  OVER  TIME  DUE  TO 
INCONSISTENT  DATABASE  COVERAGE. 


*BID-SCI  journal  set  citing  BID-MEDLINE 
papers,  1973-80.  Activity  index  normal¬ 
ized  against  Fields  1  and  2.  Citation 
counts  scaled  within  subfield  to  1973 
equivalents. 
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Table  9A  (Continued) 


BIBLIOMETRIC  PROFILE  OF  NIH 
INTRAMURAL  RESEARCH,  1973-76* 


FIELD/SUBFIELD 

NUMBER 

ACTIV 

%  INT 

%  EXT 

TOTAL 

CITES 

PER 

CITE 

X  PAPERS 
AMONG 

PAPERS 

INDEX 

EFFRT 

EFFRT 

CITES 

PAPER 

T-SCR 

TOP  10X 

CLIN  MEDICINE  [  1  ] 

GENRL  X  INTERNAL  MED 

489  . 

0  .  98 

8.85 

2.63 

10830 . 

22.2 

64  .  08 

30.21 

ALLERGY 

13  . 

1  .  38 

0 .23 

3.69 

87  . 

6.8 

48.82 

7.79 

ANESTHESIOLOGY 

5  . 

0.13 

0.09 

0 . 35 

9  . 

1 .8 

44.76 

0.00 

CANCER 

673. 

3  .  32 

12.19 

8.91 

9975. 

14.8 

53 . 38 

15.48 

CARDIOVASCULAR  SYSTM 

119. 

0.8  1 

2.16 

2.  17 

2262  . 

19.0 

59.42 

20 . 95 

DENTISTRY 

40  . 

0 .42 

0.72 

1.13 

189  . 

4.8 

55.88 

22 . 27 

DERMAT  X  VENERL  DIS 

33. 

0  .  94 

0.60 

2.5  1 

207  . 

6  .  3 

60.45 

27.14 

ENDOCRINOLOGY 

168  . 

1.00 

3.05 

2.67 

272  1  . 

16.2 

57 .66 

16.93 

FERTILITY 

9  . 

0  .  18 

0.16 

0  .47 

5  1  . 

5.7 

52 .36 

16.67 

GASTROENTEROLOGY 

20. 

0 .45 

0 . 36 

1.2  1 

297  . 

15.0 

67.70 

26 . 05 

GERIATRICS 

1  1  . 

0 . 28 

0.19 

0  .76 

37  . 

3.5 

57  .  18 

23.8  1 

HEMATOLOGY 

68  . 

1.13 

1.23 

3  .  02 

878  . 

12. 9 

6  1.19 

30.07 

IMMUNOLOGY 

46  9  . 

2.11 

8.49 

5.66 

10552. 

22.5 

58.43 

23.5  1 

OBSTETRICS  X  GYNECOL 

34. 

0 .40 

0.61 

1  .  08 

285. 

8 . 4 

55.46 

2  1.67 

NEUROL  X  NEUROSURG 

288  . 

0  .  90 

5.22 

2 . 42 

3683  . 

12.8 

52 . 48 

15.55 

OPHTHALMOLOGY 

104  . 

1.37 

1 .89 

3.67 

949  . 

9  .  1 

6  1.11 

31.68 

ORTHOPEDICS 

5. 

0.22 

0.09 

0.60 

26  . 

5.4 

54 . 90 

20.69 

ARTHRITIS  X  RHEUMAT 

20  . 

1.01 

0 . 36 

2.72 

272  . 

13.6 

68.72 

27 .50 

OTORHINOLARYNGOLOGY 

9  . 

0.17 

0.16 

0 . 45 

23. 

2.6 

49.63 

16.98 

PATHOLOGY 

74  . 

0  .  95 

1  .33 

2.53 

778. 

10.6 

60.03 

26 .30 

PEDIATRICS 

69  . 

0 .62 

1 .24 

1  .67 

59  1. 

8.6 

58 .62 

2  1.65 

PHARMACOLOGY 

186  . 

0  .  90 

3 . 37 

2 .42 

3085  . 

16.6 

58.31 

25 .72 

PHARMACY 

3  1  . 

0 . 38 

0.56 

1  .  02 

236  . 

7  .  7 

56 . 54 

14.59 

PSYCHIATRY 

2  . 

0  .  02 

0  .  04 

0.07 

23  . 

10.8 

62.80 

23 . 08 

RADIOLOGY  X  NUCL  MED 

53  . 

0 .45 

0  .  95 

1.21 

3  13. 

5  .  9 

52 .36 

12.03 

RESPIRATORY  SYSTEM 

8  . 

0 .23 

0.14 

0.6  1 

158  . 

19.7 

72.20 

60.42 

SURGERY 

96  . 

0.40 

1  .74 

1  .06 

6  30  . 

6  .  6 

53.41 

17.91 

TROPICAL  MEDICINE 

34  . 

2 . 28 

0.62 

6.12 

157  . 

4 . 6 

53.53 

19.12 

UROLOGY 

12. 

0.21 

0.21 

0  .56 

60  . 

5  .  1 

55.26 

23. 94 

NEPHROLOGY 

2. 

0 .26 

0.04 

0.69 

30  . 

14.9 

73.07 

50.00 

VETERINARY  MEDICINE 

13. 

0.25 

0.24 

0  .66 

47  . 

3 . 6 

53.26 

22.78 

ADDICTIVE  DISEASES 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

HYGIENE  X  PUB L  HLTH 

44  . 

0.85 

0.79 

2.28 

245  . 

5.6 

59.39 

2  1.84 

BIOMED  RESEARCH  [23 

PHYSIOLOGY 

92. 

0.64 

1.66 

1.7  1 

2090  . 

22.8 

58.17 

26.23 

ANATOMY  X  MORPHOLOGY 

1  1  . 

0.49 

0.19 

1 .30 

37  . 

3.5 

45.59 

0.00 

EMBRYOLOGY 

37  . 

1 .27 

0 .68 

3.4  1 

584  . 

15.6 

59.45 

20.09 

GENETICS  X  HEREDITY 

5  1  . 

0.74 

0  .  93 

1  .  98 

459  . 

8 . 9 

50.01 

9.09 

NUTRITION  X  DIETET 

1  1  . 

0.29 

0.20 

0.77 

79. 

7  .  1 

5  1.95 

18.18 

BIOCHEM  X  MOLEC  BIOL 

905. 

0  .93 

16.38 

2.50 

22443. 

24.8 

54.72 

22.92 

BIOPHYSICS 

2  1  . 

1  .  28 

0 . 38 

3.43 

174  . 

8 . 3 

54.29 

19.20 

CELL  BIOL  CYT  X  HIST 

128  . 

0 .88 

2.32 

2 . 36 

2462  . 

19.2 

54.11 

13.12 

MICROBIOLOGY 

75. 

0.57 

1  .  35 

1.52 

7  15. 

9 . 6 

53.69 

20.76 

VIROLOGY 

2  13. 

2.  18 

3.85 

5.83 

6  179. 

29  .  1 

62.62 

24 . 92 

PARASITOLOGY 

48  . 

1  .22 

0.88 

3.27 

185. 

3.8 

52.  99 

15.52 

BIOMEDICAL  ENGINRNG 

12. 

0.88 

0.2  1 

2.35 

58. 

4 . 9 

64.78 

36 .62 

MISC  BIOMEDICAL  RES 

42  . 

2.29 

0  .77 

6.14 

80  . 

1  .  9 

50 .62 

12.99 

GENRL  BIOMEDICAL  RES 

677  . 

1  .46 

12.27 

3  .  92 

1  9784  . 

29.2 

57.10 

22.8  1 
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Table  9B 


B IBLIOMETR IC  PROFILE  OF  NIH 
INTRAMURAL  RESEARCH,  1977-80* 


FIELD/LEVEL 

NUMBER 

PAPERS 

ACTIV 

INDEX 

%  I NT 
EFFRT 

X  EXT 
EFFRT 

TOTAL 

CITES 

CITES 

PER 

PAPER 

CITE 

T-SCR 

%  PAPERS 
AMONG 
TOP  10X 

XXXXXXXXXXXXXXXXXXXXXXXX 

NORMALIZED 

AGAINST 

FIELDS 

[1-21  xxxxxxxxxxxxxxxxxxxxxxxx 

FIELDS  [1-21 

65  10. 

1.00 

100.00 

2.84 

60065 . 

19.4 

59.53 

26 . 94 

CLIN  MEDICINE 

[  1  ] 

366  0  . 

0  .  92 

56 . 22 

2.6  1 

28783 . 

16  .2 

62.05 

29.41 

BIOMED  RESEARCH 

[21 

2850  . 

1.13 

43.78 

3 .20 

31077. 

23.3 

58 .46 

24.13 

LEVEL 

CLINICAL-MIX  [1 

-21 

1258  . 

0 . 58 

19.33 

1 .63 

8892. 

13.7 

6  1.46 

29.72 

CLIN  INVESTIGATN 

[31 

2272. 

1.41 

34 . 90 

4.00 

18503 . 

17.4 

62.06 

25  .  93 

BASIC  RESEARCH 

[4] 

2980  . 

1.10 

45.77 

3.12 

32355 . 

23.2 

58.49 

23.80 

xxxxxxxxxxxxxxxxxxxxxxxx 

NORMALIZED 

AGAINST 

FIELDS 

[  1-9]  xxxxxxxxxxxxxxxxxxxxxxxx 

FIELDS  [1-9] 

6577  . 

1.00 

100.00 

2.75 

59326  . 

18 . 9 

59.79 

28 .05 

CLIN  MEDICINE 

[1] 

366  0  . 

0  .  95 

55.65 

2.61 

28783 . 

16.2 

62.05 

29.41 

BIOMED  RESEARCH 

[2] 

2850  . 

1.16 

43 . 34 

3 .20 

31077. 

23 . 3 

58 .46 

24.13 

BIOLOGY 

[3] 

17  . 

0.19 

0.25 

0  .53 

19  . 

3.8 

49.41 

20.00 

CHEMISTRY 

[4] 

44  . 

0 . 58 

0.67 

1.59 

3  12. 

12.1 

57.50 

26.62 

PHYSICS 

[5] 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

EARTH  &  SPACE  SC 

[6] 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

ENGRNG  X  TECHNOL 

[7] 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

PSYCHOLOGY 

[8] 

5  . 

0  .  05 

0  .  08 

0.15 

5  . 

1  .  1 

45 . 37 

7.41 

MATHEMATICS 

[9] 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

NOTE:  CHEMISTRY  AND  PSYCHOLOGY  DATA  SHOULD  BE  TREATED  CAUTIOUSLY  OVER  TIME  DUE  TO 
INCONSISTENT  DATABASE  COVERAGE. 


*BID-SCI  journal  set.  citing  BID  -MED  L I NE 
papers,  1973-80,  but.  does  not  include  ci¬ 
tations  received  by  1979-80  publications. 
Activity  index  normalized  against  Fields  1 
and  2.  Citation  counts  scaled  within  sub¬ 
field  t.o  1973  equivalents. 
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Table  9B  (Continued) 


BIBLIOMETRIC  PROFILE  OF  NIH 
INTRAMURAL  RESEARCH,  1977-80* 


NUMBER 

ACTIV 

•X  I NT 

%  EXT 

TOTAL 

CITES 

PER 

CITE 

%  PAPERS 
AMONG 

FIELD/SUBFIELD 

PAPERS 

INDEX 

EFFRT 

EFFRT 

CITES 

PAPER 

T-SCR 

TOP  10% 

CLIN  MEDICINE  [  1  ] 

GENRL  £  INTERNAL  MED 

50  1  . 

0  .  92 

7.70 

2.6  1 

6  199. 

23.5 

63.80 

3  1.21 

ALLERGY 

16  . 

1.16 

0 .24 

3.30 

87  . 

13.5 

65.45 

30.77 

ANESTHESIOLOGY 

7  . 

0  .  18 

0.11 

0 . 52 

22. 

6 . 2 

56.60 

42.86 

CANCER 

764  . 

2.80 

11.74 

7  .  96 

6  504  . 

16.2 

56.00 

17.60 

CARDIOVASCULAR  SYSTM 

113. 

0.67 

1  .73 

1.91 

10  19. 

23 . 0 

67  .  58 

29.70 

DENTISTRY 

39. 

0 . 37 

0.59 

1.06 

67  . 

3.0 

50 . 52 

17.42 

DERMAT  £  VENERL  DIS 

32. 

0.70 

0.49 

2.00 

252. 

14.4 

77.7  1 

47 .62 

ENDOCRINOLOGY 

22  1  . 

1.16 

3 .40 

3.31 

1747  . 

20 .8 

70.99 

27.63 

FERTILITY 

9  . 

0.16 

0.13 

0  .46 

2  . 

1.8 

44.10 

0.00 

GASTROENTEROLOGY 

3  1  . 

0 .54 

0 .47 

1  .53 

207  . 

12.6 

74.52 

24.24 

GERIATRICS 

8. 

0 .26 

0.13 

0.73 

8  . 

1  .5 

48. 94 

12.90 

HEMATOLOGY 

54  . 

0 .73 

0 .83 

2. 08 

25  1  . 

8.8 

62.  93 

15.79 

IMMUNOLOGY 

654  . 

2.19 

10.05 

6.21 

6868  . 

2  1.9 

67.04 

25.35 

OBSTETRICS  8  GYNECOL 

36  . 

0  .  37 

0 .55 

1.06 

159  . 

8  .  1 

54.85 

15.25 

NEUROL  8  NEUROSURG 

283  . 

0.69 

4 . 35 

1  .  96 

1  944  . 

13.5 

55.  15 

19.42 

OPHTHALMOLOGY 

95  . 

1.10 

1  .  46 

3.11 

4  14. 

8 . 9 

58.56 

26 .07 

ORTHOPEDICS 

2. 

0  .  05 

0.03 

0.13 

0  . 

0  .  0 

0.00 

0.00 

ARTHRITIS  8  RHEUMAT 

23  . 

0  .77 

0  .35 

2.19 

223  . 

38.2 

93.  97 

51.43 

OTORHINOLARYNGOLOGY 

13. 

0  .24 

0.20 

0  .67 

0  . 

0  .  0 

42.56 

0  .  CO 

PATHOLOGY 

65  . 

0  .76 

1.00 

2.17 

258  . 

8  .  1 

56 .35 

19.37 

PEDIATRICS 

53. 

0  .35 

0.81 

1.00 

202  . 

7  .  7 

55.21 

29.75 

PHARMACOLOGY 

276  . 

1  .  04 

4 .23 

2 . 96 

1520  . 

15.0 

56 .47 

22.6  1 

PHARMACY 

53  . 

0.60 

0.8  1 

1.70 

24  0  . 

8 . 5 

58 .75 

24.85 

PSYCHIATRY 

2  1  . 

0 .22 

0  .33 

0.61 

104. 

8 . 3 

58 .67 

28.00 

RADIOLOGY  8  NUCL  MED 

55  . 

0 . 34 

0 .85 

0  .  97 

204  . 

10.5 

58 . 93 

30.77 

RESPIRATORY  SYSTEM 

17  . 

0 . 47 

0 . 27 

1  .33 

78  . 

11.4 

8  1.59 

19.51 

SURGERY 

65  . 

0 . 25 

0.99 

0.70 

292  . 

7.8 

55.17 

20 .80 

TROPICAL  MEDICINE 

43  . 

2.16 

0  .66 

6.14 

19  1. 

7.2 

60.87 

28 . 48 

UROLOGY 

17  . 

0 . 25 

0 . 26 

0.7  1 

115. 

12.5 

75.82 

36 .36 

NEPHROLOGY 

8  . 

0 .62 

0  .  12 

1  .77 

0  . 

0  .  0 

0.00 

0.00 

VETERINARY  MEDICINE 

29  . 

0  .  36 

0 .45 

1.03 

53  . 

3  .  3 

52.05 

12.24 

ADDICTIVE  DISEASES 

0  . 

0.00 

0.00 

0.00 

0  . 

0  .  0 

0.00 

0.00 

HYGIENE  8  PUBL  HLTH 

57  . 

1  .  27 

0 .87 

3.60 

125. 

5  .  0 

57.00 

26.17 

BIOMED  RESEARCH  [2] 

PHYSIOLOGY 

79  . 

0 .43 

1.21 

1  .23 

96  1  . 

23.8 

62.21 

26.03 

ANATOMY  £  MORPHOLOGY 

1  1  . 

0 .46 

0.16 

1  .30 

6  . 

1  .  3 

36.40 

0.00 

EMBRYOLOGY 

40  . 

1  .  07 

0 .62 

3.04 

160  . 

7  .  4 

37.90 

6.15 

GENETICS  £  HEREDITY 

75  . 

0  .  95 

1.15 

2.7  1 

249  . 

9  .  1 

50  .  94 

9.15 

NUTRITION  £  DIETET 

1  9  . 

0  .29 

0 .29 

C  .83 

70  . 

5  .  9 

48.40 

0.00 

BIOCHEM  £  MOL  EC  EIOL 

1233  . 

1.07 

18  .  94 

3.  04 

12680 . 

22 . 4 

57.02 

20.48 

BIOPHYSICS 

27  . 

1  .  08 

0 .42 

3.06 

89. 

7.8 

52 . 06 

22 . 06 

CELL  BIOL  CYT  £  HIST 

16  0. 

0  .  94 

2 .45 

2.67 

14  16. 

19.2 

58 .48 

19.23 

MICROBIOLOGY 

62  . 

0.50 

0  .  95 

1  .43 

334  . 

11.4 

58.72 

2  1.59 

VIROLOGY 

32  1  . 

2 . 68 

4  .  92 

7.61 

34  0  9  . 

2  1.6 

68.54 

16.91 

PARASITOLOGY 

34  . 

0 .88 

0  .53 

2.49 

6  9  . 

4 . 4 

54.49 

19.35 

BIOMEDICAL  ENGINRNG 

1  1  . 

0.61 

0.16 

1.74 

4  1  . 

5.8 

69.72 

42.86 

MISC  BIOMEDICAL  RES 

25  . 

1.4  1 

0  .  38 

3.99 

14  . 

1  .  1 

46.64 

11.69 

GENRL  BIOMEDICAL  RES 

755. 

1  .  57 

11.60 

4  .  45 

1  046  5  . 

29.6 

59.44 

22 .74 
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SUMMARY 


Bib! iometrics ,  the  development  and  analysis  of  data  on  publication, 
provides  a  reliable  method  for  assessing  support  activity  in  biomedical 
research  programs.  This  report  applies  bibliometric  techniques  to  NIH- 
supported  publications  from  1973  to  1980  in  240  selected  journals — the 
"BID-MEDLINE  data  set."  Part  I  covers  NIH  as  a  whole,  Part  II  the  intra¬ 
mural  research  program. 

As  one  application  of  bib! iometrics ,  Part  I  compares  funding  and  publi¬ 
cation,  both  for  papers  supported  by  NIH  totally  and  by  the  component  In- 
Institutes.  For  NIH  as  a  whole  the  correlation  is  very  high,  r  =  .90,  when 
funds  for  1965-77  are  compared  with  publications  three  years  later.  For 
most  of  the  individual  Institutes,  the  values  ranged  between  .70  and  .95. 

Between  1970  and  1980  total  MIH-supported  papers  increased  30  percent 
and  total  BID-MEDLINE  papers  increased  40  percent.  The  most  notable  change 
in  the  distribution  of  papers  was  an  increase  in  foreign  papers  that  re¬ 
ceived  no  NIH  support  from  29.6  percent  of  the  journal  set  to  32.9  percent. 

When  publications  are  classified  by  research  level  for  two  periods, 
1973-76  and  1977-80,  NIH  is  seen  to  have  supported  modest  increases  in  basic 
research  (14.5  percent)  and  clinical  investigation  (8.7  percent).  More 
clinically  oriented  papers  declined  slightly  (4.1  percent). 

NIH  supported  a  substantial  number  of  papers  in  nearly  every  subfield. 

In  Cancer  and  Immunology,  NIH  supported  more  than  40  percent  of  the  total 
1973-80  BID-MEDLINE  papers.  It  supported  more  than  30  percent  of  all  papers 

in  seven  other  subfields. 

NIH's  "activity  index" — a  measure  of  NIH-supported  publications  in  a 
subfield  in  relation  to  all  publication  in  that  subfield — was  highest  for 
Cancer:  1.59  in  1977-80,  or  1.59  times  the  "expected"  level.  The  other 
subfields  in  which  the  index  for  1977-80  was  higher  than  1  (and  publication 
exceeded  2,000  papers)  were  Endocrinology,  Immunology,  Physiology,  Bio¬ 
chemistry,  Molecular  Biology,  Cell  Biology-Cytology-Histology,  and  General 
Biomedical  Research. 

Between  1973-76  and  1977-80,  NIH  support,  as  compared  with  other  U.S., 
decreased  notably  in  the  clinical  subfields  Anesthesiology,  Dermatology- 
Venereal  Diseases,  Otorhinolaryngology,  and  Surgery.  All  U.S.  publication 
decreased  in  Geriatrics  and  Fertility.  In  contrast,  NIH  publications  in¬ 
creased  substantially  relative  to  the  rest  of  the  U.S.  in  the  subfields  of 
Physiology,  Immunology,  Hematology,  Biophysics,  Respiratory  System,  Virol¬ 
ogy,  Pharmacology,  and  Biochemistry-Molecular  Biology.  In  several  clinical 
subfields,  NIH  increases  lagged  well  behind  the  rest  of  the  U.S. — Allergy, 
Orthopedics,  Arthritis,  Pediatrics,  Nephrology,  and  Nutrition-Dietetics. 

NIH's  record  of  supporting  outstanding  investigators  is  manifest  in 
citations  of  NIH  publications.  In  each  of  the  21  subfields  in  which  NIH 
was  most  active  over  the  entire  period,  more  than  10  percent  of  the  NIH- 
supported  papers  were  in  the  top  decile  of  cited  papers.  Indeed,  over  10 
percent  of  the  papers  in  each  of  the  subfields  in  which  NIH  supported  any 
papers  were  in  the  top  decile. 
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That  the  Institutes  and  other  support  sources  are  interdependent  in 
their  research  is  clear  from  interaction  in  citation.  While  52  percent  of 
the  references  in  NIH-supported  papers  were  to  research  supported  by  NIH, 

48  percent  were  to  research  supported  by  others.  Conversely,  54  percent  of 
the  citations  of  NIH  research  were  in  papers  with  other  than  NIH  support. 

NIH  receives  23  percent  of  its  citations  from  foreign  papers. 

Publication  profiles  for  NIH  summarize  its  bibliometric  activity  for 
1973-76  and  1977-80. 

The  crosscutting  scientific  interests  of  NIH  programs  are  demonstrated. 
Clinical  and  basic  disciplines  that  were  substantially  supported  by  more 
than  one  Institute  are  listed.  In  each  of  14  disciplines,  only  one 
Institute  was  substantially  involved.  Predictably,  all  Institutes  supported 
a  substantial  activity  in  Biochemistry  and  Molecular  Biology. 

Finally,  Appendix  A  lists  the  10  most  highly  cited  NIH-supported  papers 
and  NIH  intramural  papers  published  each  year  from  1973  to  1977.  Similarly, 
Appendix  B  lists  papers  published  during  those  years  by  all  U.S.  and 
U.S. -supported  authors,  U.S.  authors  with  non-Federal  support,  U.S.  authors 
who  did  not  acknowledge  support,  and  foreign  authors. 


An  analysis  comparable  to  that  represented  above  is  given  for  the  NIH 
Intramural  Research  Program  (IRP),  which  accounts  for  about  10  percent  of 
NIH-supported  publications.  Again,  there  is  a  strong  correlation  between 
obligations  and  number  of  papers  published  three  years  later  (r  =  .93). 

Between  1973-76  and  1977-80,  the  percent,  but  not  number,  of  IRP  papers 
at  the  most  clinical  levels  decreased,  whereas  papers  at  the  more  basic 
levels — clinical  investigation  and  basic  research — increased  in  both  number 
and  percent. 

The  IRP  and  NIH  altogether  play  a  major  support  role  in  most  clinical 
and  basic  research  subfields,  with  10  to  50  percent  of  the  papers  in  all  but 
two  subfields  acknowledging  NIH  support.  The  areas  of  greatest  relative 
emphasis,  for  both  NIH  and  the  IRP,  are  Cancer,  Virology,  and  Immunology. 

The  activity  indexes  for  these  fields  were  2.80,  2.68,  and  2.19. 

Citation  of  NIH-supported  papers  is  analyzed  for  the  period  1973-80. 
Among  IRP  papers,  26  percent  were  in  the  top  citation  decile.  Sixteen 
percent  of  grantee  papers  were  in  that  decile.  This  outstanding  publication 
record  virtually  extends  across  the  board  of  subfields.  In  the  top  citation 
deciles  of  their  subfields  were  nearly  22  percent  of  the  IRP  papers  and 
15  percent  of  the  grantee  papers. 

Complete  publication  profiles  of  the  IRP  are  presented. 
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APPENDIX  A 


THE  TEN  MOST  HIGHLY  CITED  PAPERS 
SUPPORTED  BY  NIH  AND  BY  THE  NIH  INTRAMURAL  PROGRAM 

Appendix  A  provides  information  about  highly  cited  individual  papers. 

The  10  most  highly  cited  papers  supported  by  NIH  in  each  year,  1973  through 
1977,  are  listed  in  these  tables.  These  are  papers  in  the  BID-MEDLINE  data 
base,  cited  by  1973-80  papers.  Since  the  1978,  1979,  and  1980  papers  have 
less  than  three  full  years  of  citations  attributed  to  them  (by  1980),  they 
are  not  included  in  these  tables. 

Lists  of  the  25  most  highly  cited  papers  supported  by  each  Institute, 
and  of  the  25  most  highly  cited  in  each  subfield  and  at  each  research  level, 
for  the  years  1973  through  1977,  are  available  in  the  Program  Evaluation 
Branch,  0D,  NIH  (phone:  301/496-4418).  Information  provided  in  these  lists 
includes  citation  frequency  rank,  the  number  of  citations  received  each  year 
from  1973  through  1980,  journal  identification,  authors,  title,  L/F/S 
(level,  field,  subfield),  institutional  affiliations  of  authors,  and 
acknowledged  support  sources. 

See  also  Appendix  B  for  lists  of  the  10  most  highly  cited  papers 
published  each  year  from  1973  through  1977  in  four  categories:  (1)  U.S. 
authored  and  supported  papers,  (2)  U.S.  papers  with  non-Federal  support, 

(3)  U.S.  papers  with  support  unacknowledged,  and  (4)  foreign  papers. 
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APPENDIX  B 


In  Appendix  B  the  10  BID-MEDLINE  papers  published  each  year  from  1973  to 
1977  that  were  most  highly  cited  in  1973-80  BID-SCI  journals  are  listed  in 
four  categories:  (1)  U . S . -authored  and  -supported  papers,  (2)  U.S.  papers 
with  non-Federal  support,  (3)  U.S.  papers  with  support  unacknowledged,  and 
(4)  foreign  papers.  Papers  published  in  1978,  1979,  and  1980  are  not 
included,  as  they  have  fewer  than  three  full  years  of  citations  attributed 
to  them  (by  1980).  The  lists  include  information  on  rank  of  citation 
frequency,  the  number  of  citations  received  annually  from  1973  to  1980,  a 
reference  to  each  paper  listed,  acknowledged  support  sources,  and  authors' 
af f i 1 iations . 


86 


<n 

o 


"O 

<u 

4-J  * 

2  o 

O  CO 

CL  I 
Cl  CO 
2 

co  cd 

I  »-H 
23  c 

2  -r- 

fO 


"O 

CO 

"O 

a» 

cd 

-t-i 

X 

r-H 

•  r— 

p— 1 

o 

o 

o 

a; 

.c 

r— 

4-i 

>> 

LU 

_Q 

=3 

f— 

Cl 

03 

<: 

JZ 

CL 

h— 

CD 

< 

• 

•r— 

oo 

re 

in 

2 

• 

2 

PH 

in 

_ I 

CQ 

_ i 

•— i 

o 

LU 

2 

— 1 

o 

CL 

o 

O 

CO 

Z 

►— 

<t 

LU 

PH 

_ 1 

<C 

CQ 

in 

2 

LU 

CQ 

C 

C 

2 

2 

■ — i 

CL 

O 

p- i 

z 

o 

O 

in 

in 

CL 

2 

z 

2 

LU 

CQ 

<C 

CL 

►■H 

►H 

LU 

LU 

h- 

Z 

<£ 

O 

h- 

• 

PH 

2 

2 

O 

LL 

> 

PH 

CL 

►—  ro 

cl: 

PH 

PH 

Q 

< 

Q_ 

►— 

P“ 

PH 

in 

LU 

2 

o 

X 

2 

2  O 

Cl 

LU 

c 

p- 

CL 

3  2 

2 

a 

LU 

ro 

PH 

C  2 

<r 

ph 

LU 

1 

> 

— j  O 

2 

in 

1 

<  *  PH 

in 

2 

< 

LU 

— J 

o 

PH  vj-  P- 

C  rO 

\ 

LU 

in 

2 

PH 

O  1  < 

2  r- 

a 

— i 

o 

2 

c 

CL  O  Q 

cl: 

LU 

o 

CL 

2 

in 

LU  ro  X 

cl 

O 

2 

< 

LU 

CQ 

o 

Z  ro  ZD 

>-  lu 

C 

2 

o 

ro  P- 

< 

Z 

Z  CM  O 

_ i  m 

LU 

O 

< 

O 

2 

— 1 

O  ••  ll 

cl: 

_J 

in 

C 

O  - 

P- 

o 

o  ~ 

<  LCl 

3 

CQ 

2 

_ 1 

CL  rO  ph 

CL 

o 

00  LU 

LU  — 

o 

<c 

LU 

c 

CQ  sD 

P- 

CQ 

o 

Z  ~  O 

2 

—J 

o 

Z  1 

in 

CL 

<r 

O  OX 

n* 

2 

PH 

c  in 

x 

2 

CQ 

CL  Z  N  LU 

P-  00 

V 

2 

O 

h- 

in  m  ph 

o 

LL  CQ  ph 

<r 

<t 

> 

1 

>- 

o 

CL 

h- 

<t  O  2 

LU  I 

~  • 

X 

I— 

— J 

ro  CL 

m 

X  2  in  in  o 

O 

2 

<J> 

< 

LU 

LL 

LU  O  2  ph 

<  rO 

o 

PH 

2 

CQ  ~ 

O 

Q 

O 

►—in  — j  lu 

2  CM 

_ j 

o 

cl: 

C 

sD  2 

_ i 

in  ph  p  cl 

CL 

_ » 

cl: 

►— 

2  — 

c 

o 

2 

>-luu<o 

O  ~ 

< 

CQ 

m 

o 

LU  w 

o 

o 

O 

lOPinXLL 

PH  CM 

LU 

2 

O  CM 

PH 

< 

CL  w 

•« 

CL 

PH 

O  — 

h- 

LUCLQ  ••  •• 

LU  O' 

/“N 

in 

in 

2 

in 

< 

lu  in 

p- 

in 

in 

O 

2 

in  >- 

in 

in 

— 1 

cl  o  in  in 

O 

w 

0) 

3 

in 

CL 

w 

o 

in 

LL  <<  w  0 

<  3  -J 

CD 

L 

i— 

LU 

PH 

p- 

01 

L 

2 

1  LU  0  L 

CQLLO 

U 

"0 

c  in 

in 

u 

2 

<t 

-J  CQ  _J  U  2 

PH 

L 

“0 

LL 

N  LU  <  ph 

L 

2 

CL 

-J  ►—  L  2 

LL  cl:  CQ 

D 

< 

O 

2  CL  CL  X 

D 

< 

h~ 

LU  in  <  D  <t 

O  LU 

c 

LU  O 

LU 

O 

0^—20 

HH  _J 

in 

0) 

2 

2  2  CL  2 

in 

0 

P- 

cl  in  o 

in  c  o 

•p 

O 

— i  CL  CL  O 

-p 

2 

<UU  -P 

hDE 

-p 

0) 

PH 

LL  O  <  O  -P 

HJ 

LU 

CQ  O  -P  03 

in  p- 

L 

L 

h- 

X 

CL  2  h 

L 

L 

i— i 

2  O  CL  L  L 

>-  in  —> 

o 

o 

O 

ph  p-  in  cq 

o 

O 

O 

ph  CL  CL  O  O 

«_j 

a  a 

LU 

<t 

O 

c. 

a 

PH 

a  a 

<  ..  .. 

a  l 

►— 

CL  LU 

CL 

L 

LL 

o.  l 

2  >  C 

D 

o 

LU 

<£  — J 

>  c 

D 

o 

LL 

2  >  C  D  O 

<  CQ  H 

in 

o 

C 

CL  LU  CQ  ph  m 

o 

LU 

CL  CQ  PH  in  o 

CL 

LU 

> 

PH 

— 1 

in 

o 

LU 

2 

o 

PH 

PH 

2 

2 

• 

p- 

PH 

O 

LU 

o 

CD 

PH 

O 

LU 

Z 

►— 

2  m 

_ 1 

o 

o 

^“v 

<t 

o 

LU 

(J> 

LU 

<t 

CL  Q 

2 

►— 

r— 

ro 

Q 

2  LL 

2 

ro  2 

Z 

LU 

a 

CL 

X  LU  ro  ph 

P- 

LU 

Q 

LL 

LU 

<  WNP 

O 

PH 

►— 

o 

w- 

CL  CL  2 

LU 

CL  P-  LU  in 

in 

CL 

LU  X 

2 

O  LL  CL  LU 

Q 

<r  in  iL  lu 

>- 

O 

LU  C 

O 

o  2  c  a 

Q 

X  2  O  O 

in 

LL 

— 1 

PH 

X  LU  x  PH 

C 

PH  CL  2 

in 

<t  Q  2 

CL 

-  P-  LU 

in 

m 

2  2  -2 

ll  o 

oo  Q  in  ph 

in 

PH 

i 

PH 

O  \ 

o 

1  o  o 

LU 

CL 

LU  — 

x 

LU  CM  Q 

CL 

m  o  oc  in 

p- 

LU 

CO 

X 

2  1  LU 

LU  O 

sD  -J 

P- 

ph  CM 

o 

P  3  ro  O 

O  P- 

r^>  cq  in  — i 

LU 

O 

cm 

<-> 

—  Q 

2  2 

..  LU  C 

_J 

<c 

<t  •• 

2  2  CM  LU 

LU  <t 

CL 

CQ 

in  ^ 

>-  >• 

ph  <r  ••  _j 

in  o 

ro  <h>- 

z 

C  oo 

O  -J 

Z  ^  3  CJ 

CQ 

w  -  LU  O  X 

PH 

a 

Z  ^ 

CL  iL 

in  CL  —  O  LU 

<1 

o  o  in  lu 

in 

2 

<  o 

LU  CL 

XHW2W 

r-  X  ph  X 

•s 

< 

>- 

2  LU 

ph  <r  in  iL  ll 

LU  LL 

2  a 

<c 

LU  CQ 

LU  Q  in  O  PH 

2 

<Z  —i  — » 

PH 

2 

< 

►—  *-<p 

P-  2 

in  •> j<cq 

•• 

O 

in 

O  - 

O  ••  2  2 

PH 

2  r—  O  CL 

X 

in 

PH 

LU  2 

PH  _ 1 

CL  in  2  LU 

2  iL 

CL  ft:  LU  2 

2 

h- 

3 

X  < 

cl  in  >-  o 

ph  in 

PH<D2  J2 

LU 

<t 

PH 

o  o 

2  -j  PH 

<t 

O  LU  LU  LU  o  PH 

O 

> 

2  O 

p- 

LL  2  0 _ 12 

>-  o 

m  2  2  O  O  X 

C 

PH 

o  in 

<  2 

O  ph  O  C  2 

_ i 

►— 

P- 

►— 

LU  ph 

CQ 

Q  •• 

•  • 

2 

o 

in  o 

••  •• 

>-  h-  CQ  ••  •• 

z 

<r  ^ 

in 

Z 

<£ 

CL  < 

~  in 

ci n  ^  in 

LU  _J 

o  in 

in 

2  O 

in  in 

in  X  in  in 

in  x 

c  ^ 

o 

LU 

CL 

a  c 

w  o 

in  “iu  w  ci 

m 

0 

L 

CL 

O 

O  L 

C  2  O  L 

C  PH 

— J  u 

2 

<£ 

LL 

— j 

U  2 

CL  O  U  2 

P-  L 

2 

►— 

L  2 

O  O  L  2 

lu  m 

C  D 

C 

in 

m 

2  <£ 

D  C 

ph  X  ph  D  C 

— J  2 

2  O 

2 

LU 

CQ  2 

O 

CL  LU  CQ  O 

2  C 

in 

o 

LU 

►— 

in  o 

►-  -j  in  o 

CQ  — J 

o 

-p 

o 

c 

m  o 

-p 

LU  2  2  -P 

2  LU 

O  -P 

ru 

o 

2 

LU  O 

-p  ro 

Zoo-p  ro 

P-  2 

CL  L 

L 

2 

LU 

Z  CL 

L  L 

O  CL  L  L 

o  in 

CL  O 

O 

PH 

o 

<  CL 

o  o 

CL  CQ  C  O  O 

CL 

a 

a 

O 

o 

a  a 

o  a  a 

o  •• 

••  a 

L 

CL 

z 

a  l. 

2  ••  ••  a  l 

•— 1  >  C  0 

O 

< 

o 

>  c 

D  O 

-J  >  C  D  O 

^  CQ  t-t  01 

O 

2 

CQ  PH 

m  o 

LL  CO  PH  in  o 

uo 


CO  o 
c-  Z 


CD 

f-H  m 

u 

O  1 

ro 

r^ 

CT' 

ro 

O 

CM 

L  00  1 

sD 

sD 

Nj- 

sO 

c  aj 

O  1 

0  1 

1 

*“ 

CD  Cl 

1 —  co 

o 

sD 

— 

in 

CM 

r-*  | 

o 

O 

sD 

sD 

Q_ 

CD 

x: 

CT  1 
C  1 

—  00  1 

ro 

in 

CM 

<r 

l — 

-p  r»  1 

in 

O' 

O' 

r>- 

00 

s& 

.  | 

»— 

U  1 

n*  i 

NT 

CM 

CM 

oo 

00 

CM 

>r^  i 

<r 

o 

O' 

r>. 

-0  1 

— 

2  vO  1 

CM 

m 

00 

nT 

o 

— 

O  1 

— 

O' 

00 

r>- 

CO 

sD 

>  l 

— 

•>-  i 

<€ 

o  in  i 

vj* 

ro 

CD 

sD 

sD 

U  i 

O 

oo 

>3- 

n- 

in 

s3" 

O  1 

•“ 

L  1 

i 

rO 

00 

CM 

O 

in  r-.  i 

m 

sD 

CM 

rO 

rO 

O  1 

-p  i 

ro  1 

o  r-  1 

CM 

O 

- 

rO 

o 

in 

2  1 

CD  1 
in  >  i 
fC  CD  •—  1 

00 

O' 

CD 

CM 

-p  -P  GJ  1 

CM 

O' 

o 

sD 

s3- 

»- 

O  U  1 

00 

in 

in 

v r 

P-  O  CD  1 
CL  1 

LC  1 

C  1 

CM 

ro 

in 

re  i 
cl  i 


cn 

c 


• 

CO 

S- 

O) 

Cl 

IT3 

CL 


I 

o 


CQ 


87 
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APPENDIX  C 


LISTING  OF  THE  BID-MEDLINE  JOURNAL  SET  BY 
FIELD  AND  SUBFIELD  (WITH  LEVEL  INDICATED) 


FIELD  [1]:  CLINICAL  MEDICINE 

GENRL  &  INTERNAL  MED 


AM  J  MED  ( L2) 

AM  J  MED  SC  (L2) 

ANN  INT  MED  (Ll) 

ARCH  IN  MED  (L2) 

BIOCHEM  MED  (L3) 

CLIN  CHEM  (L3) 

CLIN  CHEM  A  (L3) 

CLIN  SC  MOL  (L3) 

J  AM  MED  A  (Ll) 

J  CHRON  DIS  (Ll) 

J  CLIN  INV  ( L3) 

J  LA  CL  MED  (L3) 

LANCET  ( L2) 

MEDICINE  (L2) 

N  ENG  J  MED  (L2) 

P  SOC  EXP  M  (L3) 

SOUTH  MED  J  (Ll) 

YALE  J  BIOL  ( L3) 

ALLERGY 

J  ALLERG  CL  (L2) 

ANESTHESIOLOGY 

ANESTH  ANAL  (L2) 

ANESTHESIOL  (L2) 

CANCER 

CANC  CHEMOT  (L3) 

CANCER  ( L2 ) 

CANCER  RES  (L3) 

INT  J  CANC  (L3) 

J  NAT  CANC  (L3) 

ONCOLOGY  (L2) 


*Journal  split.,  or  subdivided,  bet. 


CARDIOVASCULAR  SYSTM 


AM  HEART  J  (L2) 

AM  J  CARD  (L2) 

*CHEST  (Ll) 

CIRCUL  RES  (L3) 

CIRCULATION  (L2) 


DENTISTRY 

AM  J  ORTHOD  (L2) 

ARCH  ORAL  B  (L3) 

J  AM  DENT  A  (Ll) 

J  DENT  RES  (L3) 

J  PERIODONT  ( L2 ) 

ORAL  SURG  0  (L2) 

DERMAT  &  VENERL  DIS 

ARCH  DERMAT  (L2) 

J  INVES  DER  (L3) 

ENDOCRINOLOGY 

DIABETES  ( L3) 

ENDOCRINOL  (L3) 

GEN  C  ENDO  (L4) 

J  CLIN  END  ( L3) 

J  ENDOCR  ( L3) 

METABOLISM  (L3) 

NEUROENDOCR  (L3) 

FERTILITY 

FERT  STERIL  (L2) 

J  REPR  FERT  (L3) 


GASTROENTEROLOGY 

DIG  DIS  SCI  (L2) 

GASTROENTY  (L2) 


two  or  more  subfields. 


xDenot.es  journal  in  original  BID-SCI  275- journal  set.  but.  not.  in  the 
BID-MEDLINE  240-journal  set,  as  a  result,  of  coverage  changes. 
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APPENDIX  C 


LISTING  OF  THE  BID-MEDL INE  JOURNAL  SET  BY 
FIELD  AND  SUBFIELD  (WITH  LEVEL  INDICATED) 
(Continued) 

FIELD  [1]:  CLINICAL  MEDICINE  (Continued) 


GERIATRICS 


GERIATRICS  (Ll) 
GERONTOL  (Ll) 
J  AM  GER  SO  (Ll) 
J  GERONTOL  (L2) 

HEMATOLOGY 

BLOOD  (L3) 
BR  J  HAEM  ( L3) 
THROMB  DIAT  (L3) 
VOX  SANGUIN  ( L3) 

IMMUNOLOGY 

CLIN  EXP  IM  (L2) 
IMMUNOLOGY  (L3) 
J  EXP  MED  ( L3) 
J  IMMUNOL  (L3) 
J  INFEC  DIS  (L2) 
J  RETIC  SOC  (L3) 
MOL  IMMUNOL  (L3) 
TRANSPLAN  P  (L3) 
TRANSPLANT  (L3) 


OBSTETRICS  &  GYNECOL 


OPHTHALMOLOGY 

AM  J  OPHTH  (L2) 

ARCH  OPHTH  (L2) 

EXP  EYE  RES  (L3) 

INV  OPHTH  V  (L3) 

ORTHOPEDICS 

CLIN  ORTHOP  (L2 ) 

J  BONE  JOIN  (Ll) 


ARTHRITIS  &  RHEUMAT 

ANN  RHEUM  D  (L2) 

ARTH  RHEUM  (L2) 

OTORHINOLARYNGOLOGY 

ANN  OTOL  RH  (L2) 

ARCH  OTOLAR  (Ll) 

J  SPEECH  HE  (L2) 

LARYNGOSCOP  (Ll) 

PATHOLOGY 


*AM  J  OB  ST  G 

( L2 ) 

AM  J  CLIN  P 

OBSTET  GYN 

(Ll) 

AM  J  PATH 
ARCH  PATH 

NEUROL  &  NEUROSURG 

EXP  MOL  PAT 
LAB  INV 

ARCH  NE  PSY 

(Ll) 

BRAIN  RES 

(L4) 

PEDIATRICS 

DEVELOP  MED 

(L2) 

EEG  CL  NEUR 

(L3) 

AM  J  DIS  CH 

EPILEPSIA 

( L2 ) 

BIOL  NEONAT 

EXP  BRAIN  R 

(L4) 

J  PEDIAT 

EXP  NEUROL 

(L4) 

PEDIAT  RES 

J  COMP  NEUR 

(L4) 

PEDIATRICS 

J  NE  EXP  NE 

(L3) 

J  NE  NE  PSY 

(L2) 

J  NEUROCHEM 

( L4 ) 

J  NEUROSURG 

(Ll) 

J  NEURPHYSL 

( L4 ) 

NEUROLOGY 

(L2) 

VISION  RES 

(L4) 

(L2) 
(L3) 
(L2 ) 
(L3) 
(L3) 


(L2) 

(L3) 

(L2) 

(L3) 

(L2) 
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APPENDIX  C 


LISTING  OF  THE  BID-MEDL INE  JOURNAL  SET  BY 
FIELD  AND  SUBFIELD  (WITH  LEVEL  INDICATED) 
(Continued) 


FIELD  [1]:  CLINICAL  MEDICINE  (Continued) 

PHARMACOLOGY  SURGERY 


BIOCH  PHARM 

( L3) 

AM  J  SURG 

(LI) 

CLIN  PHARM 

(L2) 

ANN  SURG 

(LI) 

CURR  THER  R 

(LI) 

ARCH  SURG 

(LI) 

EUR  J  PHARM 

(L3) 

J  PED  SURG 

(LI) 

J  CLIN  PHAR 

(LI) 

J  SURG  RES 

(L2) 

J  PHARM  EXP 

(L3) 

J  THOR  SURG 

(LI) 

MOLEC  PHARM 

(L3) 

J  TRAUMA 

(LI) 

NEUROPHARM 

(L3) 

PLAS  R  SURG 

(LI) 

PHARM  REV 

(L3) 

SURG  GYN  OB 

(LI) 

PSYCHOPHARM 

(L3) 

SURGERY 

(LI) 

TOX  APPL  PH 

(L3) 

T  AM  S  ART 

(LI) 

PHARMACY 

TROPICAL  MEDICINE 

J  MED  CHEM 

(L3) 

AM  J  TROP  M 

(L2) 

J  PHARM  SCI 

(L3) 

UROLOGY 

PSYCHIATRY 

INV  UROL 

( L2 ) 

AM  J  ORTHOP 

(LI) 

J  UROL 

(LI) 

AM  J  PSYCHI 

(LI) 

*ARCH  NE  PSY 

(LI) 

NEPHROLOGY 

BR  J  PSYCHI 

(LI) 

xDIS  NER  SYS 

(LI) 

NEPHRON 

(L2) 

J  NERV  MENT 

(LI) 

J  PSYCH  RES 

(L2) 

VETERINARY  MEDICINE 

PSYCHOS  MED 

( L2) 

AM  J  VET  RE 

(L3) 

RADIOLOGY  &  NUCL 

MED 

J  AM  VET  ME 

(L2) 

AM  J  ROENTG 

(LI) 

HYGIENE  &  PUBL  HLTH 

INV  RADIOL 

(L2) 

J  NUCL  MED 

(L2) 

AM  J  EPIDEM 

(L2) 

RADIAT  RES 

( L4) 

AM  J  PUB  HE 

(LI) 

RADIOLOGY 

(L2) 

ARCH  ENV  HE 

(L2) 

SEM  ROENTG 

(LI) 

B  WHO 

(L2) 

RESPIRATORY  SYSTEM 


AM  R  RESP  D  (L2 ) 

*CHEST  (LI) 

RESP  PHYSL  ( L4) 
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LISTING  OF  THE  BID-MEDLINE  JOURNAL  SET  BY 
FIELD  AND  SUBFIELD  (WITH  LEVEL  INDICATED) 
(Continued) 


FIELD  [2]:  BIOMEDICAL  RESEARCH 

PHYSIOLOGY  BIOCHEM  &  MOLE  BIOL 


AM  J  PHYSL 

(L4) 

ANALYT  BIOC 

(L4) 

ANN  R  PHYSL 

0-4) 

ANN  R  BIOCH 

(L4) 

J  APP  PHYSL 

(L4) 

ARCH  BIOCH 

(L4) 

J  GEN  PHYSL 

(L4) 

BIOC  BIOP  A 

(L4) 

J  PHYSL  LON 

(L4) 

BIOC  BIOP  R 

(L4) 

*L IFE  SCI 

(L4) 

BIOCHEM 

(L4) 

PHYSIOL  REV 

(L4) 

BIOCHEM  J 

(L4) 

BIOPOLYMERS 

(L4) 

ANATOMY  &  MORPHOLOGY 

COLD  S  HARB 

( L4) 

EUR  J  BIOCH 

(L4) 

AM  J  ANAT 

(L4) 

FEBS  LETTER 

(L4) 

ANAT  REC 

(L4) 

J  BIOL  CHEM 

(L4) 

J  LIPID  RES 

(L4) 

EMBRYOLOGY 

J  MOL  BIOL 

(L4) 

J  THEOR  BIO 

(L4) 

DEVELOP  BIO 

(L4) 

*LIFE  SCI 

( L4 ) 

TERATOLOGY 

(L4) 

LIPIDS 

(L4) 

STEROIDS 

(L4) 

GENETICS  &  HEREDITY 

BIOPHYSICS 

AM  J  HU  GEN 

(L3) 

ANN  HUM  GEN 

(L3) 

ANN  R  BIOPH 

(L4) 

BIOCHEM  GEN 

( L4) 

BIOPHYS  J 

(L4) 

CHROMOSOMA 

(L4) 

J  BIOMECHAN 

(L4) 

GENETICS 

0-4) 

MUTAT  RES 

(L4) 

CELL  BIOL  CYT  &  HIST 

NUTRITION  &  DIETET 

ACT  CYTOL 

(L2) 

CALCIF  TISS 

(L3) 

AM  J  CLIN  N 

(L4) 

EXP  CELL  RE 

(L4) 

J  NUTR 

(L4) 

J  CELL  BIOL 

(L4) 

J  CELL  PHYS 

(L4) 

J  HIST  CYTO 

(L4) 

J  MEMBR  BIO 

(L4) 

J  ULTRA  RES 

(L4) 

STAIN  TECH 

(L4) 

MICROBIOLOGY 

ANN  R  MICRO 

(L4) 

APPL  MICROB 

(L4) 

J  BACT 

(L4) 

J  GEN  MICRO 

(L4) 
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LISTING  OF  THE  BID-MEDLINE  JOURNAL  SET  BY 
FIELD  AND  SUBFIELD  (WITH  LEVEL  INDICATED) 
(Continued) 


FIELD  [2]:  BIOMEDICAL  RESEARCH  (Continued) 

VIROLOGY 


J  GEN  VIROL  (L4) 

J  VIROLOGY  (L4) 

VIROLOGY  ( L4 ) 

PARASITOLOGY 

EXP  PARASIT  (L4) 

J  PARASITOL  ( L4 ) 

J  PROTOZOOL  ( L4 ) 

BIOMEDICAL  ENGINEERING 

COMPUT  BIOM  (L3) 

IEEE  BIOMED  (L3) 

MISC  BIOMEDICAL  RES 

HUMAN  BIOL  (L3) 

LAB  ANIM  SC  (L3) 

GENRL  BIOMEDICAL  RES 

*ANN  NY  ACAD  (L4) 

*EXPERIENTIA  (L4) 

♦FED  PROC  ( L4 ) 

♦LIFE  SCI  ( L4 ) 

♦NATURE  ( L4 ) 

*P  NAS  US  (L4) 

♦SCIENCE  ( L4 ) 
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LISTING  OF  THE  BID-MEDLINE  JOURNALS  SET  BY 
FIELD  AND  SUBFIELD  (WITH  LEVEL  INDICATED) 
(Continued) 

(BID-MEDLINE  JOURNALS  IN  FIELDS  OTHER  THAN  1  and  2) 


FIELD  [3]:  BIOLOGY 


GENERAL  BIOLOGY 


BOTANY 


*ANN  NY  ACAD 

(L4) 

xPHYTOCHEM 

( L4 ) 

*EXPERIENTIA 

(L4) 

xPLANT  PHYSL 

(L4) 

♦NATURE 

(L4) 

*P  NAS  US 

(L4) 

AGRICULT  &  FOOD  SCI 

♦SCIENCE 

( L4) 

J  AGR  FOOD 

(L3) 

GENERAL  ZOOLOGY 

DAIRY  &  ANIMAL  SCI 

xAM  ZOOLOG 

(L4) 

J  ANIM  SCI 

(L3) 

J  EXP  ZOOL 

(L4) 

J  DAIRY  SCI 

(L3) 

ENTOMOLOGY 

MISCELLANEOUS  BIOL 

J  MED  ENT 

(L3) 

AM  J  P  ANTH 

(L4) 

MISCELLANEOUS  ZOOL 


COMP  BIOCH  (L4) 

FIELD  [4]:  CHEMISTRY 

ANALYTICAL  CHEMISTRY  GENERAL  CHEMISTRY 


ANALYT  CHEM 

( L3) 

♦ANN  NY  ACAD 

(L4) 

J  CHROMAT 

(L3) 

♦CHEM  COMM 

(L4) 

♦EXPERIENTIA 

( L4 ) 

ORGANIC  CHEMISTRY 

xJ  AM  CHEM  S 

( L4 ) 

*x J  CHEM  S 

(L4) 

CARBOHY  RES 

(L4) 

xJ  CHEM  S  CH 

( L4 ) 

♦xJ  CHEM  S 

(L4 ) 

♦NATURE 

(L4) 

xJ  HETERO  CH 

( L4 ) 

*P  NAS  US 

(L4) 

xJ  ORG  CHEM 

(L4) 

♦SCIENCE 

(L4) 

xTETRAHEDR  L 

(L4) 

PHYSICAL  CHEMISTRY 

INORGANIC  &  NUCL 

CHM 

xACT  CRYST 

(L4) 

xINORG  CHEM 

(L4) 

*x J  CHEM  S 

(L4) 

xJ  CHEM  S  D 

(L4) 

xJ  PHYS  CHEM 

(L4) 
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LISTING  OF  THE  BID-MEDLINE  JOURNAL  SET  BY 
FIELD  AND  SUBFIELD  (WITH  LEVEL  INDICATED) 
(Continued) 


FIELD  [5]:  PHYSICS 

CHEMICAL  PHYSICS 

xj  CHEM  PHYS  (L4) 

*xj  CHEM  S  (L4 ) 

ACOUSTICS 

xJ  ACOUST  SO  (L3) 

FIELD  [8]:  PSYCHOLOGY 


CLINICAL  PSYCHOLOGY 


xj  ABN  PSYCH  (LI) 

PERSONALITY  &  SOC  PS 

xJ  PERS  SOC  (LI) 

DEVEL  &  CHILD  PSYCHO 

xCHILD  DEV  (L2 ) 

xj  EXP  C  PSY  (L2) 

EXPERIMENTAL  PSYCHOL 

J  COM  PHYSL  (L4) 

J  EXP  PSYCH  (L4) 

NEUROPSYCHO  (L3) 

xPERC  MOT  SK  (L2) 

xPERC  PSYCH  (L4) 

PSYCHOPHYSL  (L3) 


GENERAL  PSYCHOLOGY 

xJ  PSYCHOL  (LI) 
xPSYCHOL  REP  (L2) 
^SCIENCE  ( L4 ) 


MISC  PSYCHOLOGY 

AM  J  MENT  D  (Ll) 


BEHAVIORAL  SCIENCE 

xBEHAV  RES  M  (L4) 

xJ  APPL  BE  A  (Ll) 

J  EXP  AN  BE  ( L3) 

PHYSL  BEHAV  (L4) 
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